Aug 04 09:07:30.124752 ip-10-0-143-202 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 09:07:30.568731 ip-10-0-143-202 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 09:07:30.568731 ip-10-0-143-202 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 09:07:30.568731 ip-10-0-143-202 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 09:07:30.568731 ip-10-0-143-202 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 09:07:30.568731 ip-10-0-143-202 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 09:07:30.570909 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.570824    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 09:07:30.577163 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577146    2554 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 09:07:30.577163 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577163    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577167    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577170    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577174    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577177    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577180    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577183    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577191    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577194    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577197    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577200    2554 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577203    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577205    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577208    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577211    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577213    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577216    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577218    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577221    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 09:07:30.577227 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577223    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577226    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577229    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577231    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577234    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577237    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577239    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577242    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577245    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577247    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577250    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577252    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577254    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577257    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577259    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577262    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577264    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577266    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577269    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577272    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 09:07:30.577750 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577274    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577277    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577279    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577282    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577284    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577287    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577289    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577292    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577294    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577298    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577300    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577303    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577305    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577307    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577311    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577314    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577316    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577319    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577321    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577324    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 09:07:30.578236 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577328    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577333    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577335    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577338    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577340    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577343    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577345    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577348    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577350    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577353    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577355    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577358    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577361    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577364    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577366    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577368    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577371    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577373    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577376    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577378    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 09:07:30.578740 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577380    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577383    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577385    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577388    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577390    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577393    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577397    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577400    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577403    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577405    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577408    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577410    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577413    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577417    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577421    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577424    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577427    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577429    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.577432    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 09:07:30.579219 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578114    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578120    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578123    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578126    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578129    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578132    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578135    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578138    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578140    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578143    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578146    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578148    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578151    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578154    2554 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578156    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578159    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578161    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578164    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578166    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578169    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 09:07:30.579710 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578172    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578175    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578177    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578180    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578183    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578185    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578188    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578190    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578192    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578195    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578197    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578200    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578202    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578204    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578207    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578210    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578212    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578214    2554 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578218    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578220    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 09:07:30.580214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578223    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578225    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578227    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578230    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578233    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578237    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578242    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578246    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578249    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578252    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578255    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578258    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578261    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578266    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578269    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578272    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578275    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578278    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 09:07:30.580724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578281    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578285    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578287    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578291    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578294    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578296    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578299    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578302    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578304    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578306    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578309    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578311    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578314    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578317    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578320    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578322    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578325    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578328    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578331    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 09:07:30.581183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578333    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578336    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578338    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578341    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578343    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578345    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578348    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578351    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578353    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578356    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578358    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578361    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578363    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578366    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578369    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578371    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578374    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578376    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578378    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578381    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 09:07:30.581669 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578383    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578385    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578786    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578792    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578795    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578800    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578804    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578808    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578811    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578814    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578817    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578820    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578822    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578825    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578828    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578830    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578833    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578836    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578838    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 09:07:30.582158 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578842    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578846    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578848    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578851    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578853    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578856    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578858    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578861    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578863    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578865    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578868    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578870    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578873    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578875    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578878    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578881    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578884    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578886    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578889    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 09:07:30.582771 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578891    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578894    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578897    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578900    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578903    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578907    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578910    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578913    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578916    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578919    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578922    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578924    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578927    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578930    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578933    2554 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578935    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578938    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578941    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578943    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 09:07:30.583235 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578946    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578948    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578951    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578953    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578956    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578958    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578961    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578963    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578968    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578970    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578973    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578976    2554 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578978    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578980    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578983    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578988    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578992    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578994    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578997    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.578999    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 09:07:30.583724 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579002    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579005    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579007    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579009    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579012    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579014    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579017    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579019    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579022    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579026    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579028    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579030    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579033    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579035    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579038    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579040    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579043    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579045    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579048    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579050    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 09:07:30.584243 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579054    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579056    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579059    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579061    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579125    2554 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579137    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579143    2554 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579148    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579152    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579156    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579160    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579164    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579167    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579170    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579173    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579176    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579179    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579182    2554 flags.go:64] FLAG: --cgroup-root=""
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579185    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579188    2554 flags.go:64] FLAG: --client-ca-file=""
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579191    2554 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579194    2554 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579198    2554 flags.go:64] FLAG: --cluster-domain=""
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579200    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 09:07:30.584744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579204    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579207    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579210    2554 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579214    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579216    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579219    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579223    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579225    2554 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579229    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579232    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579235    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579238    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579242    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579245    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579248    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579250    2554 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579253    2554 flags.go:64] FLAG: --enable-server="true"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579256    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579261    2554 flags.go:64] FLAG: --event-burst="100"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579264    2554 flags.go:64] FLAG: --event-qps="50"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579266    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579269    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579272    2554 flags.go:64] FLAG: --eviction-hard=""
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579275    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 09:07:30.585330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579278    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579281    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579284    2554 flags.go:64] FLAG: --eviction-soft=""
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579286    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579289    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579292    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579294    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579299    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579302    2554 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579305    2554 flags.go:64] FLAG: --feature-gates=""
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579308    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579311    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579314    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579317    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579320    2554 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579322    2554 flags.go:64] FLAG: --help="false"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579325    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579329    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579332    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579335    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579338    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579341    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579344    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 09:07:30.585920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579347    2554 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579350    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579352    2554 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579356    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579359    2554 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579362    2554 flags.go:64] FLAG: --kube-reserved=""
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579364    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579367    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579370    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579372    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579375    2554 flags.go:64] FLAG: --lock-file=""
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579377    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579380    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579383    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579388    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579391    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579395    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579398    2554 flags.go:64] FLAG: --logging-format="text"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579400    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579403    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579406    2554 flags.go:64] FLAG: --manifest-url=""
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579409    2554 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579413    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579416    2554 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579419    2554 flags.go:64] FLAG: --max-pods="110"
Aug 04 09:07:30.586537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579423    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579426    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579428    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579431    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579434    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579437    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579439    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579446    2554 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579449    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579464    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579468    2554 flags.go:64] FLAG: --pod-cidr=""
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579471    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579476    2554 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579479    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579482    2554 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579485    2554 flags.go:64] FLAG: --port="10250"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579488    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579491    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08388c257c9be4f76"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579494    2554 flags.go:64] FLAG: --qos-reserved=""
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579497    2554 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579500    2554 flags.go:64] FLAG: --register-node="true"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579502    2554 flags.go:64] FLAG: --register-with-taints=""
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579506    2554 flags.go:64] FLAG: --registry-burst="10"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579510    2554 flags.go:64] FLAG: --registry-qps="5"
Aug 04 09:07:30.587174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579513    2554 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579516    2554 flags.go:64] FLAG: --reserved-memory=""
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579519    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579522    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579525    2554 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579527    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579530    2554 flags.go:64] FLAG: --runonce="false"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579533    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579536    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579539    2554 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579542    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579544    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579547    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579550    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579553    2554 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579555    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579558    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579561    2554 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579564    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579566    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579570    2554 flags.go:64] FLAG: --system-cgroups=""
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579573    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579578    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579580    2554 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579583    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 09:07:30.587825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579587    2554 flags.go:64] FLAG: --tls-min-version=""
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579590    2554 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579592    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579595    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579598    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579600    2554 flags.go:64] FLAG: --v="2"
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579605    2554 flags.go:64] FLAG: --version="false"
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579609    2554 flags.go:64] FLAG: --vmodule=""
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579612    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.579615    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579733    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579738    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579741    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579744    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579746    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579749    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579755    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579757    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579760    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579763    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579767    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 09:07:30.588428 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579770    2554 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579773    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579776    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579779    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579781    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579784    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579786    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579789    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579791    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579794    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579796    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579799    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579801    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579803    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579806    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579809    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579811    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579814    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579817    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579819    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 09:07:30.588953 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579821    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579824    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579826    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579828    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579831    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579833    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579836    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579840    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579842    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579845    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579847    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579851    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579854    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579857    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579859    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579862    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579865    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579867    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579870    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 09:07:30.589442 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579873    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579876    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579879    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579881    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579884    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579887    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579889    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579891    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579894    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579896    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579899    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579901    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579904    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579907    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579909    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579912    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579914    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579916    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579919    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579922    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 09:07:30.589923 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579925    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579928    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579930    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579933    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579935    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579937    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579940    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579942    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579945    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579947    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579950    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579952    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579955    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579957    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579960    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579962    2554 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579965    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579968    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579970    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579972    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 09:07:30.590408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579975    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579977    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579980    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579982    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579985    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579987    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579990    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579992    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.579994    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.580878    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.589423    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.589438    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.589473    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.589480    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589563    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 09:07:30.590911 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589568    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589571    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589574    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589577    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589582    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589586    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589589    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589592    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589595    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589597    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589600    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589608    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589611    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589613    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589616    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589618    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589621    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589623    2554 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589626    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 09:07:30.591294 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589628    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589631    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589633    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589635    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589638    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589641    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589643    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589645    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589648    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589651    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589653    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589663    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589666    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589669    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589671    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589685    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589689    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589692    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589695    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589698    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 09:07:30.591790 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589700    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589703    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589705    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589708    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589711    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589719    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589722    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589725    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589727    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589730    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589732    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589735    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589737    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589740    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589742    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589744    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589747    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589749    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589751    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589754    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 09:07:30.592273 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589757    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589760    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589763    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589765    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589769    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589772    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589775    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589778    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589782    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589784    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589787    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589790    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589792    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589795    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589797    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589799    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589802    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589805    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589812    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 09:07:30.592762 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589815    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589818    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589820    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589822    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589825    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589828    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589830    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589832    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589835    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589837    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589839    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589842    2554 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589845    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589850    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589853    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589855    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589858    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589860    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589863    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 09:07:30.593228 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.589865    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.589870    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590010    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590014    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590017    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590020    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590023    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590025    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590028    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590030    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590033    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590035    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590037    2554 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590045    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590048    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 09:07:30.593753 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590051    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590053    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590056    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590059    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590062    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590064    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590066    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590069    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590071    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590074    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590076    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590078    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590081    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590083    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590086    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590088    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590090    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590093    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590095    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 09:07:30.594143 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590097    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590100    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590102    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590104    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590107    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590109    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590111    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590115    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590118    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590121    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590123    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590126    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590134    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590136    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590139    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590142    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590144    2554 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590146    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590149    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590151    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 09:07:30.594655 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590154    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590156    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590158    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590160    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590163    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590165    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590168    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590170    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590172    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590175    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590177    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590179    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590183    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590186    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590188    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590191    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590193    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590195    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590198    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590200    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 09:07:30.595142 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590203    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590205    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590208    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590210    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590212    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590221    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590223    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590227    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590230    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590233    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590236    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590238    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590241    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590243    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590245    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590248    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590250    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590252    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590255    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 09:07:30.595659 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590257    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590260    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590262    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590264    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590266    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590269    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590272    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:30.590274    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.590279    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.590386    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.593565    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.595051    2554 server.go:1019] "Starting client certificate rotation"
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.595150    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 09:07:30.596124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.595846    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 09:07:30.598886 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.598861    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 09:07:30.600983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.600962    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 09:07:30.614414 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.614392    2554 log.go:25] "Validated CRI v1 runtime API"
Aug 04 09:07:30.616973 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.616958    2554 log.go:25] "Validated CRI v1 image API"
Aug 04 09:07:30.617738 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.617725    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 09:07:30.621685 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.621655    2554 fs.go:135] Filesystem UUIDs: map[4ad19d1c-cbd1-4ae8-b255-a96c61e3245a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9aedb0e1-c124-49fa-bd54-aa4b4acc57f7:/dev/nvme0n1p4]
Aug 04 09:07:30.621753 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.621682    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 09:07:30.627640 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.627533    2554 manager.go:216] Machine: {Timestamp:2026-08-04 09:07:30.626163197 +0000 UTC m=+0.371569599 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499994 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f445b58c7ba16cb2b6c906ae7171b SystemUUID:ec2f445b-58c7-ba16-cb2b-6c906ae7171b BootID:20773c04-213f-419c-8b4d-81bc8e64361d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:33:bd:5f:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:33:bd:5f:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:87:f1:31:69:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 09:07:30.627640 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.627634    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 09:07:30.627781 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.627750    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 09:07:30.630486 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.630450    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 09:07:30.630637 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.630487    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 09:07:30.630747 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.630732    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 09:07:30.631322 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.631311    2554 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 09:07:30.631354 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.631324    2554 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 09:07:30.631354 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.631332    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 09:07:30.632087 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.632076    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 09:07:30.633223 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.633213    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 09:07:30.637320 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637308    2554 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 09:07:30.637441 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637431    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 09:07:30.637497 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637489    2554 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 09:07:30.637531 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637505    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 09:07:30.637560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637541    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 09:07:30.637560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637554    2554 kubelet.go:398] "Adding apiserver pod source"
Aug 04 09:07:30.637609 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637566    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 09:07:30.637985 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.637975    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 09:07:30.638024 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.638014    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 09:07:30.641655 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.641617    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 09:07:30.643510 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.643494    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 09:07:30.643561 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.643526    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 09:07:30.644950 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644934    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 09:07:30.644950 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644952    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644958    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644963    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644971    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644976    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644984    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644989    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.644996    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.645001    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.645010    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 09:07:30.645081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.645015    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 09:07:30.646147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.646137    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 09:07:30.646147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.646147    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 09:07:30.648611 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.648595    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 09:07:30.649265 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.649243    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 09:07:30.649319 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.649244    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 09:07:30.649482 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.649470    2554 server.go:1268] "Started kubelet"
Aug 04 09:07:30.649632 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.649575    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 09:07:30.649716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.649651    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 09:07:30.649716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.649595    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 09:07:30.650274 ip-10-0-143-202 systemd[1]: Started Kubernetes Kubelet.
Aug 04 09:07:30.651362 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.651345    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 09:07:30.652293 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.652277    2554 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 09:07:30.655877 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.655853    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 09:07:30.658383 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.657375    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-202.ec2.internal.18c88ef89a9d1a72  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-202.ec2.internal,UID:ip-10-0-143-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-202.ec2.internal,},FirstTimestamp:2026-08-04 09:07:30.64942245 +0000 UTC m=+0.394828852,LastTimestamp:2026-08-04 09:07:30.64942245 +0000 UTC m=+0.394828852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-202.ec2.internal,}"
Aug 04 09:07:30.660439 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.660423    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 09:07:30.660439 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.660435    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 09:07:30.660576 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.660561    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:30.660940 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.660923    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 09:07:30.660940 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.660924    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 09:07:30.661074 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.660949    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 09:07:30.661074 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.661058    2554 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 09:07:30.661074 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.661068    2554 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 09:07:30.662247 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662217    2554 factory.go:153] Registering CRI-O factory
Aug 04 09:07:30.662247 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662238    2554 factory.go:223] Registration of the crio container factory successfully
Aug 04 09:07:30.662400 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662297    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 09:07:30.662400 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662305    2554 factory.go:55] Registering systemd factory
Aug 04 09:07:30.662400 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662310    2554 factory.go:223] Registration of the systemd container factory successfully
Aug 04 09:07:30.662400 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662327    2554 factory.go:103] Registering Raw factory
Aug 04 09:07:30.662400 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662345    2554 manager.go:1196] Started watching for new ooms in manager
Aug 04 09:07:30.662928 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.662739    2554 manager.go:349] Starting recovery of all containers
Aug 04 09:07:30.664298 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.664262    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 09:07:30.664420 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.664398    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 09:07:30.674576 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.674556    2554 manager.go:354] Recovery completed
Aug 04 09:07:30.678677 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.678664    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 09:07:30.680371 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.680340    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 09:07:30.680467 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.680384    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 09:07:30.680467 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.680397    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientPID"
Aug 04 09:07:30.680873 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.680856    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 09:07:30.680873 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.680869    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 09:07:30.680967 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.680871    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 09:07:30.680967 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.680945    2554 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 09:07:30.681524 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.681509    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 09:07:30.681605 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.681533    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 09:07:30.681605 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.681548    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientPID"
Aug 04 09:07:30.681691 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.681627    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nhzv"
Aug 04 09:07:30.682097 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.682084    2554 policy_none.go:49] "None policy: Start"
Aug 04 09:07:30.682132 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.682105    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 09:07:30.682357 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.682296    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-202.ec2.internal.18c88ef89c754bd2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-202.ec2.internal,UID:ip-10-0-143-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-202.ec2.internal,},FirstTimestamp:2026-08-04 09:07:30.680368082 +0000 UTC m=+0.425774483,LastTimestamp:2026-08-04 09:07:30.680368082 +0000 UTC m=+0.425774483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-202.ec2.internal,}"
Aug 04 09:07:30.682521 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.682503    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 09:07:30.683470 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.683444    2554 policy_none.go:47] "Start"
Aug 04 09:07:30.690654 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.690638    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nhzv"
Aug 04 09:07:30.691310 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.691252    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-202.ec2.internal.18c88ef89c75a507  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-202.ec2.internal,UID:ip-10-0-143-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-202.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-202.ec2.internal,},FirstTimestamp:2026-08-04 09:07:30.680390919 +0000 UTC m=+0.425797321,LastTimestamp:2026-08-04 09:07:30.680390919 +0000 UTC m=+0.425797321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-202.ec2.internal,}"
Aug 04 09:07:30.715244 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.715106    2554 manager.go:337] "Starting Device Plugin manager"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.715268    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.715282    2554 server.go:87] "Starting device plugin registration server"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.715518    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.715530    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.715633    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.715726    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.715735    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.716179    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 09:07:30.731579 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.716228    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:30.773597 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.773573    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 09:07:30.774878 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.774853    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 09:07:30.774958 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.774886    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 09:07:30.774958 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.774902    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 09:07:30.774958 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.774931    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 09:07:30.777676 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.777654    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 09:07:30.816574 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.816555    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 09:07:30.817385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.817371    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 09:07:30.817481 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.817399    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 09:07:30.817481 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.817409    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientPID"
Aug 04 09:07:30.817481 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.817432    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.828399 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.828350    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.828399 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.828375    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-202.ec2.internal\": node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:30.856501 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.856448    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:30.875425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.875400    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal"]
Aug 04 09:07:30.875522 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.875482    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 09:07:30.877009 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.876993    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 09:07:30.877094 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.877026    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 09:07:30.877094 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.877038    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientPID"
Aug 04 09:07:30.878394 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.878382    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 09:07:30.878569 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.878557    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.878606 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.878592    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 09:07:30.879157 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.879141    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 09:07:30.879240 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.879167    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 09:07:30.879240 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.879180    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientPID"
Aug 04 09:07:30.879240 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.879147    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 09:07:30.879381 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.879250    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 09:07:30.879381 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.879274    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientPID"
Aug 04 09:07:30.880787 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.880772    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.880878 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.880801    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 09:07:30.881556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.881538    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 09:07:30.881624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.881568    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 09:07:30.881624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.881577    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeHasSufficientPID"
Aug 04 09:07:30.916251 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.916229    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-202.ec2.internal\" not found" node="ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.920926 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.920910    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-202.ec2.internal\" not found" node="ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.957273 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:30.957249    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:30.962252 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.962234    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e45daf01c7ddea46a25573911e9f0bc-config\") pod \"kube-apiserver-proxy-ip-10-0-143-202.ec2.internal\" (UID: \"2e45daf01c7ddea46a25573911e9f0bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.962318 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.962262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b6e89ec59b61309996e494c45807448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal\" (UID: \"6b6e89ec59b61309996e494c45807448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:30.962382 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:30.962329    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6e89ec59b61309996e494c45807448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal\" (UID: \"6b6e89ec59b61309996e494c45807448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.057828 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.057793    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:31.063164 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.063146    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b6e89ec59b61309996e494c45807448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal\" (UID: \"6b6e89ec59b61309996e494c45807448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.063237 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.063179    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6e89ec59b61309996e494c45807448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal\" (UID: \"6b6e89ec59b61309996e494c45807448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.063237 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.063205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e45daf01c7ddea46a25573911e9f0bc-config\") pod \"kube-apiserver-proxy-ip-10-0-143-202.ec2.internal\" (UID: \"2e45daf01c7ddea46a25573911e9f0bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.063318 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.063238    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b6e89ec59b61309996e494c45807448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal\" (UID: \"6b6e89ec59b61309996e494c45807448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.063318 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.063240    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e45daf01c7ddea46a25573911e9f0bc-config\") pod \"kube-apiserver-proxy-ip-10-0-143-202.ec2.internal\" (UID: \"2e45daf01c7ddea46a25573911e9f0bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.063318 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.063264    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6e89ec59b61309996e494c45807448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal\" (UID: \"6b6e89ec59b61309996e494c45807448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.158614 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.158553    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:31.220116 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.220096    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.224596 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.224126    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.258727 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.258698    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:31.359186 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.359158    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:31.459703 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.459631    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-202.ec2.internal\" not found"
Aug 04 09:07:31.484346 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.484328    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 09:07:31.560814 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.560781    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.575232 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.575209    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 09:07:31.577546 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.577532    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal"
Aug 04 09:07:31.586814 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.586797    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 09:07:31.593865 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.593847    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 09:07:31.593994 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.593977    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 09:07:31.638397 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.638367    2554 apiserver.go:52] "Watching apiserver"
Aug 04 09:07:31.646857 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.646828    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 09:07:31.647184 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.647163    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5whhp","kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn","openshift-cluster-node-tuning-operator/tuned-8rr8z","openshift-image-registry/node-ca-pn5ft","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal","openshift-multus/multus-additional-cni-plugins-d46d7","openshift-multus/network-metrics-daemon-zft9s","kube-system/konnectivity-agent-pr9wb","openshift-dns/node-resolver-p98p4","openshift-multus/multus-75bls","openshift-network-diagnostics/network-check-target-gph88","openshift-network-operator/iptables-alerter-jzktd","openshift-ovn-kubernetes/ovnkube-node-snbxf"]
Aug 04 09:07:31.648970 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.648951    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.649050 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.649029    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:31.650380 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.650362    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.651560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.651537    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.652736 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.652720    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.652930 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.652909    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 09:07:31.652930 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.652913    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 09:07:31.653074 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.652937    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tmmwr\""
Aug 04 09:07:31.653188 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.653174    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 09:07:31.653822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.653808    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.654355 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.654340    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 09:07:31.654469 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.654426    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:07:31.654621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.654605    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6f7sq\""
Aug 04 09:07:31.655007 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.654993    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:31.655087 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.655061    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:31.656075 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.656058    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 09:07:31.656215 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.656168    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 09:07:31.656215 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.656188    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:31.656343 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.656320    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m88qh\""
Aug 04 09:07:31.656397 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.656353    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 09:07:31.657316 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.657299    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 09:07:31.657393 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.657303    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 09:07:31.657537 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.657523    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.657753 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.657736    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 09:07:31.658336 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.658323    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 09:07:31.658529 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.658517    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gzj64\""
Aug 04 09:07:31.658858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.658844    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6klgn\""
Aug 04 09:07:31.658988 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.658953    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.659746 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.659715    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 09:07:31.660046 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.660025    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 09:07:31.660258 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.660242    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 09:07:31.660503 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.660480    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ttsfc\""
Aug 04 09:07:31.660568 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.660555    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 09:07:31.661291 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.660625    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 09:07:31.661291 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.660721    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 09:07:31.661291 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.661093    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:31.661291 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.661163    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:31.662075 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.662058    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 09:07:31.663106 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.662311    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7ncv5\""
Aug 04 09:07:31.663106 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.662690    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.664477 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.664443    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.665226 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.665208    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bvcfm\""
Aug 04 09:07:31.665414 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.665400    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 09:07:31.665704 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.665687    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:07:31.666012 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.665999    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ade0fdde-53c5-4073-ad65-ae5ae3755bac-serviceca\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666760    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-kubernetes\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln5v9\" (UniqueName: \"kubernetes.io/projected/2ce2d7fc-300e-4927-990b-9bcb88779a18-kube-api-access-ln5v9\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666790    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-os-release\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666804    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysctl-conf\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666818    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666837    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbrdk\" (UniqueName: \"kubernetes.io/projected/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-kube-api-access-zbrdk\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666860    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-multus-certs\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666892    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdlqp\" (UniqueName: \"kubernetes.io/projected/78ddb8c7-5495-45a1-b336-a18f3743bc6a-kube-api-access-bdlqp\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666944    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-cni-bin\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.666982    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-daemon-config\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667012    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-host\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667054    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-system-cni-dir\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667121    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-conf-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667147    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-kubelet-config\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667174    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysctl-d\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-var-lib-kubelet\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667230    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-tuned\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667247    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-kubelet\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667268    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c985c47-1dde-47f0-920d-3750deed20ab-host-slash\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667292    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667314    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667328    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f875b2cd-646a-4128-b58a-8f11599cd89a-konnectivity-ca\") pod \"konnectivity-agent-pr9wb\" (UID: \"f875b2cd-646a-4128-b58a-8f11599cd89a\") " pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667349    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa959971-7124-4e82-ac32-243e2d21618b-hosts-file\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667372    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa959971-7124-4e82-ac32-243e2d21618b-tmp-dir\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667390    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-cnibin\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667404    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-hostroot\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667419    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-socket-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.667494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667470    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-lib-modules\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-cni-multus\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667518    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-etc-kubernetes\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667543    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667568    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-run\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667595    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8gzm\" (UniqueName: \"kubernetes.io/projected/fa959971-7124-4e82-ac32-243e2d21618b-kube-api-access-k8gzm\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667619    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-cni-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667638    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ddb8c7-5495-45a1-b336-a18f3743bc6a-cni-binary-copy\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667652    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667670    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-dbus\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667714    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-registration-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667754    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgh5n\" (UniqueName: \"kubernetes.io/projected/ade0fdde-53c5-4073-ad65-ae5ae3755bac-kube-api-access-xgh5n\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667774    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667818    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-system-cni-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667834    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-k8s-cni-cncf-io\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667852    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysconfig\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.667987 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667872    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667887    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptqnx\" (UniqueName: \"kubernetes.io/projected/808a8f84-514c-4f38-b761-2c3375d70ec0-kube-api-access-ptqnx\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667901    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-socket-dir-parent\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667920    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-sys-fs\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-systemd\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667956    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-sys\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667972    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.667993    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-netns\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668016    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-device-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668030    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d7fc-300e-4927-990b-9bcb88779a18-tmp\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668043    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ade0fdde-53c5-4073-ad65-ae5ae3755bac-host\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668065    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f875b2cd-646a-4128-b58a-8f11599cd89a-agent-certs\") pod \"konnectivity-agent-pr9wb\" (UID: \"f875b2cd-646a-4128-b58a-8f11599cd89a\") " pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668098    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-os-release\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668124    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c985c47-1dde-47f0-920d-3750deed20ab-iptables-alerter-script\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668147    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jccb\" (UniqueName: \"kubernetes.io/projected/0c985c47-1dde-47f0-920d-3750deed20ab-kube-api-access-2jccb\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668185    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cnibin\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668211    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82n8w\" (UniqueName: \"kubernetes.io/projected/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-kube-api-access-82n8w\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.668575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668234    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 09:07:31.669143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668242    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-modprobe-d\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.669143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668278    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 09:07:31.669143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668301    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 09:07:31.669143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668328    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 09:07:31.669143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668340    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wnz2q\""
Aug 04 09:07:31.669143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668480    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 09:07:31.669143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.668636    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 09:07:31.678414 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.678396    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 09:07:31.694873 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.694825    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 09:02:30 +0000 UTC" deadline="2028-05-10 17:46:29.68153484 +0000 UTC"
Aug 04 09:07:31.694873 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.694871    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15488h38m57.986665782s"
Aug 04 09:07:31.705384 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.705366    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kdf7b"
Aug 04 09:07:31.721544 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.721491    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kdf7b"
Aug 04 09:07:31.762147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.762133    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 09:07:31.768898 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.768879    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-cni-multus\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.768983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.768900    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-etc-kubernetes\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.768983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.768918    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.768983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.768932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-run\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.768983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.768952    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25f2w\" (UniqueName: \"kubernetes.io/projected/f8242793-a448-4e49-94d6-1f0ee6166191-kube-api-access-25f2w\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.768983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.768977    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8gzm\" (UniqueName: \"kubernetes.io/projected/fa959971-7124-4e82-ac32-243e2d21618b-kube-api-access-k8gzm\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769002    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-etc-kubernetes\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769007    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-cni-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769054    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-cni-multus\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769084    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769065    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ddb8c7-5495-45a1-b336-a18f3743bc6a-cni-binary-copy\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769115    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-run\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769133    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769142    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-cni-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769165    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-dbus\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769193    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-registration-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769221    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769231    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-dbus\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.769261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769258    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgh5n\" (UniqueName: \"kubernetes.io/projected/ade0fdde-53c5-4073-ad65-ae5ae3755bac-kube-api-access-xgh5n\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769275    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769295    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-system-cni-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769275    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-registration-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769311    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-k8s-cni-cncf-io\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769328    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysconfig\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-env-overrides\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769384    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-system-cni-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769415    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769436    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnx\" (UniqueName: \"kubernetes.io/projected/808a8f84-514c-4f38-b761-2c3375d70ec0-kube-api-access-ptqnx\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769450    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysconfig\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769517    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-socket-dir-parent\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769566    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-k8s-cni-cncf-io\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-socket-dir-parent\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769603    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-sys-fs\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769611    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ddb8c7-5495-45a1-b336-a18f3743bc6a-cni-binary-copy\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769651    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-systemd\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.769856 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769675    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-sys\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769712    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-run-netns\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769737    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-log-socket\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769764    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.769715    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769792    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-netns\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769815    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-sys\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769817    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-device-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769864    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-netns\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.769868    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:32.26982125 +0000 UTC m=+2.015227655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769897    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-device-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769928    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d7fc-300e-4927-990b-9bcb88779a18-tmp\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769963    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-cni-bin\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769974    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-systemd\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769985    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.769992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ade0fdde-53c5-4073-ad65-ae5ae3755bac-host\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770019    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f875b2cd-646a-4128-b58a-8f11599cd89a-agent-certs\") pod \"konnectivity-agent-pr9wb\" (UID: \"f875b2cd-646a-4128-b58a-8f11599cd89a\") " pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:31.770621 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-os-release\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770075    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ade0fdde-53c5-4073-ad65-ae5ae3755bac-host\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770107    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c985c47-1dde-47f0-920d-3750deed20ab-iptables-alerter-script\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770141    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-os-release\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770160    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jccb\" (UniqueName: \"kubernetes.io/projected/0c985c47-1dde-47f0-920d-3750deed20ab-kube-api-access-2jccb\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770190    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-var-lib-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770220    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-etc-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770221    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770248    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-ovnkube-config\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770305    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770311    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-sys-fs\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770310    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cnibin\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770343    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cnibin\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770361    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82n8w\" (UniqueName: \"kubernetes.io/projected/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-kube-api-access-82n8w\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770386    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-modprobe-d\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770416    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-cni-netd\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770486    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.771409 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770507    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ade0fdde-53c5-4073-ad65-ae5ae3755bac-serviceca\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770523    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-kubernetes\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770521    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-modprobe-d\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770539    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln5v9\" (UniqueName: \"kubernetes.io/projected/2ce2d7fc-300e-4927-990b-9bcb88779a18-kube-api-access-ln5v9\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770585    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-kubernetes\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770641    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770673    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-ovnkube-script-lib\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770701    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-os-release\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770726    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysctl-conf\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770727    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c985c47-1dde-47f0-920d-3750deed20ab-iptables-alerter-script\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770763    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-systemd\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770789    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770803    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-os-release\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770810    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbrdk\" (UniqueName: \"kubernetes.io/projected/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-kube-api-access-zbrdk\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770833    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-kubelet\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770841    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysctl-conf\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770858    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-multus-certs\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770881    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlqp\" (UniqueName: \"kubernetes.io/projected/78ddb8c7-5495-45a1-b336-a18f3743bc6a-kube-api-access-bdlqp\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770901    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-systemd-units\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770920    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-ovn\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770938    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ade0fdde-53c5-4073-ad65-ae5ae3755bac-serviceca\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770980    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-run-multus-certs\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770989    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-cni-bin\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.770942    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-cni-bin\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771039    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-daemon-config\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771073    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-host\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771098    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-node-log\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-system-cni-dir\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771195    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771206    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-host\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771263    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-system-cni-dir\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771536    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-conf-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771156    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-conf-dir\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.772864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771603    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-kubelet-config\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771618    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysctl-d\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771632    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-var-lib-kubelet\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771646    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-tuned\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771651    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ddb8c7-5495-45a1-b336-a18f3743bc6a-multus-daemon-config\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771660    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-kubelet\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c985c47-1dde-47f0-920d-3750deed20ab-host-slash\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771729    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-kubelet-config\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771739    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771750    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-sysctl-d\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771767    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f875b2cd-646a-4128-b58a-8f11599cd89a-konnectivity-ca\") pod \"konnectivity-agent-pr9wb\" (UID: \"f875b2cd-646a-4128-b58a-8f11599cd89a\") " pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771775    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-var-lib-kubelet\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771808    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c985c47-1dde-47f0-920d-3750deed20ab-host-slash\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa959971-7124-4e82-ac32-243e2d21618b-hosts-file\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771848    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771857    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-host-var-lib-kubelet\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.771852    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:31.773385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771875    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa959971-7124-4e82-ac32-243e2d21618b-tmp-dir\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771902    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa959971-7124-4e82-ac32-243e2d21618b-hosts-file\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-cnibin\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.771913    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret podName:cbcb9552-fcb4-4a61-8686-311e5c65e2a3 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:32.271897683 +0000 UTC m=+2.017304071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret") pod "global-pull-secret-syncer-5whhp" (UID: "cbcb9552-fcb4-4a61-8686-311e5c65e2a3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771944    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-hostroot\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771947    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-cnibin\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771981    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-socket-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-lib-modules\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772047    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-slash\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.771984    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ddb8c7-5495-45a1-b336-a18f3743bc6a-hostroot\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772069    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-socket-dir\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772075    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-run-ovn-kubernetes\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772376    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8242793-a448-4e49-94d6-1f0ee6166191-ovn-node-metrics-cert\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772731    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ce2d7fc-300e-4927-990b-9bcb88779a18-lib-modules\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772862    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f875b2cd-646a-4128-b58a-8f11599cd89a-konnectivity-ca\") pod \"konnectivity-agent-pr9wb\" (UID: \"f875b2cd-646a-4128-b58a-8f11599cd89a\") " pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:31.774219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.772917    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa959971-7124-4e82-ac32-243e2d21618b-tmp-dir\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.774954 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.774302    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d7fc-300e-4927-990b-9bcb88779a18-tmp\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.774954 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.774932    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f875b2cd-646a-4128-b58a-8f11599cd89a-agent-certs\") pod \"konnectivity-agent-pr9wb\" (UID: \"f875b2cd-646a-4128-b58a-8f11599cd89a\") " pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:31.776525 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.776493    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d7fc-300e-4927-990b-9bcb88779a18-etc-tuned\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.776985 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.776970    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 09:07:31.777078 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.776990    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 09:07:31.777078 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.777003    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nd94k for pod openshift-network-diagnostics/network-check-target-gph88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:31.777078 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:31.777066    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k podName:cccde668-6515-486f-a053-e9471621ea90 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:32.277049713 +0000 UTC m=+2.022456122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nd94k" (UniqueName: "kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k") pod "network-check-target-gph88" (UID: "cccde668-6515-486f-a053-e9471621ea90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:31.780929 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.780911    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgh5n\" (UniqueName: \"kubernetes.io/projected/ade0fdde-53c5-4073-ad65-ae5ae3755bac-kube-api-access-xgh5n\") pod \"node-ca-pn5ft\" (UID: \"ade0fdde-53c5-4073-ad65-ae5ae3755bac\") " pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:31.785163 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.785142    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8gzm\" (UniqueName: \"kubernetes.io/projected/fa959971-7124-4e82-ac32-243e2d21618b-kube-api-access-k8gzm\") pod \"node-resolver-p98p4\" (UID: \"fa959971-7124-4e82-ac32-243e2d21618b\") " pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:31.787208 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.787188    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82n8w\" (UniqueName: \"kubernetes.io/projected/43bed49f-5533-477d-9de5-6b9f6eb0b6c8-kube-api-access-82n8w\") pod \"aws-ebs-csi-driver-node-hklfn\" (UID: \"43bed49f-5533-477d-9de5-6b9f6eb0b6c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:31.788133 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.788112    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jccb\" (UniqueName: \"kubernetes.io/projected/0c985c47-1dde-47f0-920d-3750deed20ab-kube-api-access-2jccb\") pod \"iptables-alerter-jzktd\" (UID: \"0c985c47-1dde-47f0-920d-3750deed20ab\") " pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.788373 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.788357    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptqnx\" (UniqueName: \"kubernetes.io/projected/808a8f84-514c-4f38-b761-2c3375d70ec0-kube-api-access-ptqnx\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:31.788814 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.788794    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdlqp\" (UniqueName: \"kubernetes.io/projected/78ddb8c7-5495-45a1-b336-a18f3743bc6a-kube-api-access-bdlqp\") pod \"multus-75bls\" (UID: \"78ddb8c7-5495-45a1-b336-a18f3743bc6a\") " pod="openshift-multus/multus-75bls"
Aug 04 09:07:31.791440 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.791419    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln5v9\" (UniqueName: \"kubernetes.io/projected/2ce2d7fc-300e-4927-990b-9bcb88779a18-kube-api-access-ln5v9\") pod \"tuned-8rr8z\" (UID: \"2ce2d7fc-300e-4927-990b-9bcb88779a18\") " pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:31.791765 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.791748    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbrdk\" (UniqueName: \"kubernetes.io/projected/3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3-kube-api-access-zbrdk\") pod \"multus-additional-cni-plugins-d46d7\" (UID: \"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3\") " pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:31.800596 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.800585    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jzktd"
Aug 04 09:07:31.861403 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.861375    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 09:07:31.873654 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873627    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-systemd\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.873654 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873655    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-kubelet\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.873829 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-systemd-units\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.873829 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873695    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-ovn\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.873829 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873734    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-ovn\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.873829 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873736    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-kubelet\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.873829 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873765    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-systemd\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.873829 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873763    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-systemd-units\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-node-log\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873876    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-slash\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873893    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-run-ovn-kubernetes\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873926    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8242793-a448-4e49-94d6-1f0ee6166191-ovn-node-metrics-cert\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873938    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-slash\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.873965    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25f2w\" (UniqueName: \"kubernetes.io/projected/f8242793-a448-4e49-94d6-1f0ee6166191-kube-api-access-25f2w\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874008    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-node-log\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874011    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-run-ovn-kubernetes\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874012    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874043    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-run-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874092 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874077    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-env-overrides\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874103    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-run-netns\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874128    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-log-socket\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874155    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-cni-bin\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874172    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-run-netns\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874208    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-cni-bin\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874218    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-log-socket\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-var-lib-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-etc-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874306    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-ovnkube-config\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874320    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-var-lib-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874335    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-cni-netd\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874376    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-etc-openvswitch\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874381    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-cni-netd\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874403    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874433    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-ovnkube-script-lib\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874493    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8242793-a448-4e49-94d6-1f0ee6166191-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.874602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874542    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-env-overrides\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.875103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874769    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-ovnkube-config\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.875103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.874885    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f8242793-a448-4e49-94d6-1f0ee6166191-ovnkube-script-lib\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.876228 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.876207    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8242793-a448-4e49-94d6-1f0ee6166191-ovn-node-metrics-cert\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.882707 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.882691    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25f2w\" (UniqueName: \"kubernetes.io/projected/f8242793-a448-4e49-94d6-1f0ee6166191-kube-api-access-25f2w\") pod \"ovnkube-node-snbxf\" (UID: \"f8242793-a448-4e49-94d6-1f0ee6166191\") " pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:31.986177 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:31.986114    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn"
Aug 04 09:07:32.003568 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.003547    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rr8z"
Aug 04 09:07:32.009228 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.009209    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pn5ft"
Aug 04 09:07:32.011894 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.011872    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 09:07:32.022988 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.022971    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d46d7"
Aug 04 09:07:32.043628 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.043605    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:32.057306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.057289    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p98p4"
Aug 04 09:07:32.069807 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.069787    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75bls"
Aug 04 09:07:32.106656 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.106631    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:32.277843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.277759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:32.277843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.277818    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.277851    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.277946    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.277985    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.278021    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret podName:cbcb9552-fcb4-4a61-8686-311e5c65e2a3 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:33.27799811 +0000 UTC m=+3.023404506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret") pod "global-pull-secret-syncer-5whhp" (UID: "cbcb9552-fcb4-4a61-8686-311e5c65e2a3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.278044    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:33.278031704 +0000 UTC m=+3.023438109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.278092    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.278109    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 09:07:32.278148 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.278121    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nd94k for pod openshift-network-diagnostics/network-check-target-gph88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:32.278592 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.278166    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k podName:cccde668-6515-486f-a053-e9471621ea90 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:33.278149272 +0000 UTC m=+3.023555663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd94k" (UniqueName: "kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k") pod "network-check-target-gph88" (UID: "cccde668-6515-486f-a053-e9471621ea90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:32.352603 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.352567    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e469dfe_3fa7_4f8a_ad28_5fa847bee2f3.slice/crio-892782a5c5d3f221b21c01987cee2d4c091b9934595d1a063f6f26500fa01704 WatchSource:0}: Error finding container 892782a5c5d3f221b21c01987cee2d4c091b9934595d1a063f6f26500fa01704: Status 404 returned error can't find the container with id 892782a5c5d3f221b21c01987cee2d4c091b9934595d1a063f6f26500fa01704
Aug 04 09:07:32.353592 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.353565    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e45daf01c7ddea46a25573911e9f0bc.slice/crio-ec7a7f2f7f2ee1b2e2527da9f2632b7e434a726ee990a7ff8fd06db5973850ab WatchSource:0}: Error finding container ec7a7f2f7f2ee1b2e2527da9f2632b7e434a726ee990a7ff8fd06db5973850ab: Status 404 returned error can't find the container with id ec7a7f2f7f2ee1b2e2527da9f2632b7e434a726ee990a7ff8fd06db5973850ab
Aug 04 09:07:32.354463 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.354443    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c985c47_1dde_47f0_920d_3750deed20ab.slice/crio-6abfbb32c0955334466b22dc432ae3e89f907359d1c6b345082475bd03e7b62a WatchSource:0}: Error finding container 6abfbb32c0955334466b22dc432ae3e89f907359d1c6b345082475bd03e7b62a: Status 404 returned error can't find the container with id 6abfbb32c0955334466b22dc432ae3e89f907359d1c6b345082475bd03e7b62a
Aug 04 09:07:32.356436 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.356406    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade0fdde_53c5_4073_ad65_ae5ae3755bac.slice/crio-b5533dc34119b12f468f23ea046e4e0724c5266d9c1b5d2391053a50590954f6 WatchSource:0}: Error finding container b5533dc34119b12f468f23ea046e4e0724c5266d9c1b5d2391053a50590954f6: Status 404 returned error can't find the container with id b5533dc34119b12f468f23ea046e4e0724c5266d9c1b5d2391053a50590954f6
Aug 04 09:07:32.357675 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.357647    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 09:07:32.407303 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.407270    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf875b2cd_646a_4128_b58a_8f11599cd89a.slice/crio-3670cbd4aed3f472fffc0773bcfc43bb4fd2482e129da122bc496ede6f6850db WatchSource:0}: Error finding container 3670cbd4aed3f472fffc0773bcfc43bb4fd2482e129da122bc496ede6f6850db: Status 404 returned error can't find the container with id 3670cbd4aed3f472fffc0773bcfc43bb4fd2482e129da122bc496ede6f6850db
Aug 04 09:07:32.471876 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.471850    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce2d7fc_300e_4927_990b_9bcb88779a18.slice/crio-33951635b43b44fc12e19d6e4f76be3d73b449a08615760d59dec6e42316641e WatchSource:0}: Error finding container 33951635b43b44fc12e19d6e4f76be3d73b449a08615760d59dec6e42316641e: Status 404 returned error can't find the container with id 33951635b43b44fc12e19d6e4f76be3d73b449a08615760d59dec6e42316641e
Aug 04 09:07:32.472663 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.472635    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43bed49f_5533_477d_9de5_6b9f6eb0b6c8.slice/crio-9f29b4d66ea5b276e53c29fcbc6461991ab7dc73709e7ddc93105a7fbe176414 WatchSource:0}: Error finding container 9f29b4d66ea5b276e53c29fcbc6461991ab7dc73709e7ddc93105a7fbe176414: Status 404 returned error can't find the container with id 9f29b4d66ea5b276e53c29fcbc6461991ab7dc73709e7ddc93105a7fbe176414
Aug 04 09:07:32.504075 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.504047    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8242793_a448_4e49_94d6_1f0ee6166191.slice/crio-89056ea7b18f2f1e93507fe8fa4cf0f14d780d179ec479842864333a05c0218a WatchSource:0}: Error finding container 89056ea7b18f2f1e93507fe8fa4cf0f14d780d179ec479842864333a05c0218a: Status 404 returned error can't find the container with id 89056ea7b18f2f1e93507fe8fa4cf0f14d780d179ec479842864333a05c0218a
Aug 04 09:07:32.505707 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.505639    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 09:07:32.533579 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.533553    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6e89ec59b61309996e494c45807448.slice/crio-9f4c9d071d0f10212427d064d8b33897aec9ea1ba82a173cc2a381dd0e24ac92 WatchSource:0}: Error finding container 9f4c9d071d0f10212427d064d8b33897aec9ea1ba82a173cc2a381dd0e24ac92: Status 404 returned error can't find the container with id 9f4c9d071d0f10212427d064d8b33897aec9ea1ba82a173cc2a381dd0e24ac92
Aug 04 09:07:32.723414 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.723356    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 09:02:31 +0000 UTC" deadline="2028-01-14 01:12:53.591233232 +0000 UTC"
Aug 04 09:07:32.723414 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.723408    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12664h5m20.867829949s"
Aug 04 09:07:32.779005 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.778976    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:32.779184 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.778976    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:32.779184 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.779087    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:32.779184 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:32.779150    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:32.779958 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.779913    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"89056ea7b18f2f1e93507fe8fa4cf0f14d780d179ec479842864333a05c0218a"}
Aug 04 09:07:32.781071 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.781040    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn" event={"ID":"43bed49f-5533-477d-9de5-6b9f6eb0b6c8","Type":"ContainerStarted","Data":"9f29b4d66ea5b276e53c29fcbc6461991ab7dc73709e7ddc93105a7fbe176414"}
Aug 04 09:07:32.782179 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.782120    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pn5ft" event={"ID":"ade0fdde-53c5-4073-ad65-ae5ae3755bac","Type":"ContainerStarted","Data":"b5533dc34119b12f468f23ea046e4e0724c5266d9c1b5d2391053a50590954f6"}
Aug 04 09:07:32.783161 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.783130    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal" event={"ID":"2e45daf01c7ddea46a25573911e9f0bc","Type":"ContainerStarted","Data":"ec7a7f2f7f2ee1b2e2527da9f2632b7e434a726ee990a7ff8fd06db5973850ab"}
Aug 04 09:07:32.784274 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.784240    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jzktd" event={"ID":"0c985c47-1dde-47f0-920d-3750deed20ab","Type":"ContainerStarted","Data":"6abfbb32c0955334466b22dc432ae3e89f907359d1c6b345082475bd03e7b62a"}
Aug 04 09:07:32.785202 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.785168    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal" event={"ID":"6b6e89ec59b61309996e494c45807448","Type":"ContainerStarted","Data":"9f4c9d071d0f10212427d064d8b33897aec9ea1ba82a173cc2a381dd0e24ac92"}
Aug 04 09:07:32.786252 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.786230    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rr8z" event={"ID":"2ce2d7fc-300e-4927-990b-9bcb88779a18","Type":"ContainerStarted","Data":"33951635b43b44fc12e19d6e4f76be3d73b449a08615760d59dec6e42316641e"}
Aug 04 09:07:32.787336 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.787313    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pr9wb" event={"ID":"f875b2cd-646a-4128-b58a-8f11599cd89a","Type":"ContainerStarted","Data":"3670cbd4aed3f472fffc0773bcfc43bb4fd2482e129da122bc496ede6f6850db"}
Aug 04 09:07:32.788491 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:32.788451    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerStarted","Data":"892782a5c5d3f221b21c01987cee2d4c091b9934595d1a063f6f26500fa01704"}
Aug 04 09:07:32.852544 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:07:32.852493    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa959971_7124_4e82_ac32_243e2d21618b.slice/crio-3b2878dcead8153571c943d4dfa87ebeedc782adb27387311ad8f96e0b47a2c8 WatchSource:0}: Error finding container 3b2878dcead8153571c943d4dfa87ebeedc782adb27387311ad8f96e0b47a2c8: Status 404 returned error can't find the container with id 3b2878dcead8153571c943d4dfa87ebeedc782adb27387311ad8f96e0b47a2c8
Aug 04 09:07:33.284649 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.284613    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:33.284805 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.284668    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:33.284805 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.284734    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:33.284929 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.284860    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:33.284929 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.284904    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 09:07:33.284929 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.284921    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 09:07:33.284929 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.284923    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret podName:cbcb9552-fcb4-4a61-8686-311e5c65e2a3 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:35.284902711 +0000 UTC m=+5.030309107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret") pod "global-pull-secret-syncer-5whhp" (UID: "cbcb9552-fcb4-4a61-8686-311e5c65e2a3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:33.284929 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.284931    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nd94k for pod openshift-network-diagnostics/network-check-target-gph88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:33.285205 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.284972    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k podName:cccde668-6515-486f-a053-e9471621ea90 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:35.284960278 +0000 UTC m=+5.030366673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd94k" (UniqueName: "kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k") pod "network-check-target-gph88" (UID: "cccde668-6515-486f-a053-e9471621ea90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:33.285205 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.285019    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:33.285205 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.285042    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:35.285034379 +0000 UTC m=+5.030440769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:33.724095 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.724049    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 09:02:31 +0000 UTC" deadline="2028-03-02 09:07:43.797820867 +0000 UTC"
Aug 04 09:07:33.724095 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.724093    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13824h0m10.073732555s"
Aug 04 09:07:33.775732 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.775657    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:33.775901 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:33.775786    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:33.817053 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.817004    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75bls" event={"ID":"78ddb8c7-5495-45a1-b336-a18f3743bc6a","Type":"ContainerStarted","Data":"fda56ed0c94b08317abf446ff0c66917a231be13601f420b761e4919e0c96cc5"}
Aug 04 09:07:33.827619 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:33.827567    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p98p4" event={"ID":"fa959971-7124-4e82-ac32-243e2d21618b","Type":"ContainerStarted","Data":"3b2878dcead8153571c943d4dfa87ebeedc782adb27387311ad8f96e0b47a2c8"}
Aug 04 09:07:34.780434 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:34.780336    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:34.780918 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:34.780472    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:34.781221 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:34.781200    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:34.781326 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:34.781302    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:35.304812 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:35.304774    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:35.304990 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:35.304843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:35.304990 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:35.304879    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:35.305103 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305044    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:35.305156 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305111    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:39.305091142 +0000 UTC m=+9.050497530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:35.305549 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305528    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:35.305646 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305588    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret podName:cbcb9552-fcb4-4a61-8686-311e5c65e2a3 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:39.305571899 +0000 UTC m=+9.050978288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret") pod "global-pull-secret-syncer-5whhp" (UID: "cbcb9552-fcb4-4a61-8686-311e5c65e2a3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:35.305708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305677    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 09:07:35.305708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305692    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 09:07:35.305708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305705    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nd94k for pod openshift-network-diagnostics/network-check-target-gph88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:35.305852 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.305744    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k podName:cccde668-6515-486f-a053-e9471621ea90 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:39.305731669 +0000 UTC m=+9.051138078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd94k" (UniqueName: "kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k") pod "network-check-target-gph88" (UID: "cccde668-6515-486f-a053-e9471621ea90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:35.776146 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:35.776069    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:35.776298 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:35.776213    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:36.775898 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:36.775393    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:36.775898 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:36.775397    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:36.775898 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:36.775537    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:36.775898 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:36.775579    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:37.776228 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:37.775726    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:37.776228 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:37.775878    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:38.775761 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:38.775721    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:38.775946 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:38.775858    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:38.775946 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:38.775908    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:38.776047 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:38.776018    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:39.347201 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:39.347162    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:39.347211    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:39.347242    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347319    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347329    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347357    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347384    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347386    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:47.347369065 +0000 UTC m=+17.092775458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347395    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nd94k for pod openshift-network-diagnostics/network-check-target-gph88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347404    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret podName:cbcb9552-fcb4-4a61-8686-311e5c65e2a3 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:47.347396308 +0000 UTC m=+17.092802697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret") pod "global-pull-secret-syncer-5whhp" (UID: "cbcb9552-fcb4-4a61-8686-311e5c65e2a3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:39.347708 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.347435    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k podName:cccde668-6515-486f-a053-e9471621ea90 nodeName:}" failed. No retries permitted until 2026-08-04 09:07:47.347424621 +0000 UTC m=+17.092831010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd94k" (UniqueName: "kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k") pod "network-check-target-gph88" (UID: "cccde668-6515-486f-a053-e9471621ea90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:39.775365 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:39.775291    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:39.775960 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:39.775431    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:40.776710 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:40.776684    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:40.777129 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:40.776791    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:40.777129 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:40.776835    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:40.777129 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:40.776889    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:41.775662 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:41.775631    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:41.775846 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:41.775764    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:42.775422 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:42.775391    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:42.775903 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:42.775521    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:42.775903 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:42.775586    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:42.775903 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:42.775720    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:43.775574 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:43.775538    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:43.776039 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:43.775690    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:44.775639 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:44.775614    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:44.775958 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:44.775648    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:44.775958 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:44.775732    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:44.775958 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:44.775870    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:45.775806 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:45.775775    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:45.776281 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:45.775926    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:46.776133 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:46.776097    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:46.776554 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:46.776232    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:46.776554 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:46.776291    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:46.776554 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:46.776405    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:47.407475 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:47.407414    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:47.407649 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:47.407527    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:47.407649 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:47.407567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:47.407649 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407574    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:47.407649 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407647    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret podName:cbcb9552-fcb4-4a61-8686-311e5c65e2a3 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:03.407626041 +0000 UTC m=+33.153032431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret") pod "global-pull-secret-syncer-5whhp" (UID: "cbcb9552-fcb4-4a61-8686-311e5c65e2a3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 09:07:47.407839 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407719    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 09:07:47.407839 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407732    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:47.407839 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407741    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 09:07:47.407839 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407757    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nd94k for pod openshift-network-diagnostics/network-check-target-gph88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:47.407839 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407803    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:03.407782593 +0000 UTC m=+33.153189002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:07:47.407839 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.407825    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k podName:cccde668-6515-486f-a053-e9471621ea90 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:03.407814869 +0000 UTC m=+33.153221259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd94k" (UniqueName: "kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k") pod "network-check-target-gph88" (UID: "cccde668-6515-486f-a053-e9471621ea90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:07:47.775291 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:47.775216    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:47.775443 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:47.775333    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:48.776053 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:48.776023    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:48.776600 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:48.776138    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:48.776600 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:48.776205    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:48.776600 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:48.776281    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:49.775611 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:49.775577    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:49.775804 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:49.775719    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:50.776361 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:50.776323    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:50.776765 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:50.776406    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:50.776765 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:50.776419    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:50.776765 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:50.776535    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:51.775228 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:51.775198    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:51.775419 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:51.775323    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:52.775852 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:52.775824    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:52.776241 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:52.775824    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:52.776241 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:52.775920    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:52.776241 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:52.776022    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:53.775558 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.775231    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:53.775685 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:53.775646    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:53.867635 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.867599    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75bls" event={"ID":"78ddb8c7-5495-45a1-b336-a18f3743bc6a","Type":"ContainerStarted","Data":"0064fe33072cfd079ec36f558442bcecad37987c086f78ec82690c35e06ef1bc"}
Aug 04 09:07:53.868975 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.868954    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p98p4" event={"ID":"fa959971-7124-4e82-ac32-243e2d21618b","Type":"ContainerStarted","Data":"33f85792a57bc7fb642e6f3873807aab4b98917a9817c891df52172036ce211e"}
Aug 04 09:07:53.871836 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.871814    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"0f6d28f74ce7900eff7f64877ee74b4a867e4ed81d310b659d45725d5caee9ee"}
Aug 04 09:07:53.871949 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.871889    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"03447cefe82f501de0c97ef7a64f4f30ff5bf20ff479e77636276b5e2ddf399a"}
Aug 04 09:07:53.871949 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.871940    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"845c4d73540503cc6dcf712a14acb7be8cb1d4b2632f6875db0097fdcbf7205e"}
Aug 04 09:07:53.872067 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.871987    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"1337f2f95f5718a4a1492a0d79c0920b23711f35c6f29f8f322f85eef771d36b"}
Aug 04 09:07:53.872067 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.872035    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"a9ab92f1d8790a8c451afd348d4472f019320d3d25164304ef7a447488c335e8"}
Aug 04 09:07:53.872155 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.872082    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"c70a66fd79eff529a57c98c2e95147f1ed771428fd562aae6e15007292d1578a"}
Aug 04 09:07:53.873279 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.873257    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn" event={"ID":"43bed49f-5533-477d-9de5-6b9f6eb0b6c8","Type":"ContainerStarted","Data":"8fecc20daed5fa25c2dd20d9b91fdab22a917b5b060c5b5b3b703804dcb6130b"}
Aug 04 09:07:53.875676 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.875657    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pn5ft" event={"ID":"ade0fdde-53c5-4073-ad65-ae5ae3755bac","Type":"ContainerStarted","Data":"42a6d27b70a56500c0d3421cdfd7eebecfef66156a8848526ae5bebc17c1228c"}
Aug 04 09:07:53.876956 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.876937    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal" event={"ID":"2e45daf01c7ddea46a25573911e9f0bc","Type":"ContainerStarted","Data":"00d22d3973cff254ac8d1d870a7ef43828b87139aa278c008c7da56d92bdc7c4"}
Aug 04 09:07:53.878355 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.878334    2554 generic.go:356] "Generic (PLEG): container finished" podID="6b6e89ec59b61309996e494c45807448" containerID="9a9ed64be642100368e62c7c721d27289c3fe73b76a81a8de10d2db03df56947" exitCode=0
Aug 04 09:07:53.878442 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.878385    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal" event={"ID":"6b6e89ec59b61309996e494c45807448","Type":"ContainerDied","Data":"9a9ed64be642100368e62c7c721d27289c3fe73b76a81a8de10d2db03df56947"}
Aug 04 09:07:53.879744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.879724    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rr8z" event={"ID":"2ce2d7fc-300e-4927-990b-9bcb88779a18","Type":"ContainerStarted","Data":"947aa66951208c559273f75b2fc61525d6ee068026ca806c72dfc88674821dd9"}
Aug 04 09:07:53.881108 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.881090    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pr9wb" event={"ID":"f875b2cd-646a-4128-b58a-8f11599cd89a","Type":"ContainerStarted","Data":"90fa016f8895e6905a10bf718db207a4cf6402bb0026c325c21f460e88321a56"}
Aug 04 09:07:53.882401 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.882382    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3" containerID="928d800f7c7a02da024956e64298dd380f477100af482777e6fa32f5a70d0b42" exitCode=0
Aug 04 09:07:53.882495 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.882410    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerDied","Data":"928d800f7c7a02da024956e64298dd380f477100af482777e6fa32f5a70d0b42"}
Aug 04 09:07:53.911276 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.911235    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-75bls" podStartSLOduration=3.260389376 podStartE2EDuration="22.911222728s" totalImagesPullingTime="19.650833352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:53.887819462 +0000 UTC m=+23.633225874" watchObservedRunningTime="2026-08-04 09:07:53.911222728 +0000 UTC m=+23.656629138"
Aug 04 09:07:53.942760 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.942722    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pr9wb" podStartSLOduration=2.503283229 podStartE2EDuration="22.942708643s" totalImagesPullingTime="20.439425414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:53.92396992 +0000 UTC m=+23.669376330" watchObservedRunningTime="2026-08-04 09:07:53.942708643 +0000 UTC m=+23.688115053"
Aug 04 09:07:53.962462 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.962422    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p98p4" podStartSLOduration=2.941794637 podStartE2EDuration="22.962409348s" totalImagesPullingTime="20.020614711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:53.94329452 +0000 UTC m=+23.688700931" watchObservedRunningTime="2026-08-04 09:07:53.962409348 +0000 UTC m=+23.707815804"
Aug 04 09:07:53.981555 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:53.981515    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-202.ec2.internal" podStartSLOduration=22.981502893 podStartE2EDuration="22.981502893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:53.962483362 +0000 UTC m=+23.707889773" watchObservedRunningTime="2026-08-04 09:07:53.981502893 +0000 UTC m=+23.726909304"
Aug 04 09:07:54.002148 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.002110    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8rr8z" podStartSLOduration=2.601111774 podStartE2EDuration="23.002098796s" totalImagesPullingTime="20.400987022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:53.981121575 +0000 UTC m=+23.726527985" watchObservedRunningTime="2026-08-04 09:07:54.002098796 +0000 UTC m=+23.747505216"
Aug 04 09:07:54.002249 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.002190    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pn5ft" podStartSLOduration=2.533237567 podStartE2EDuration="23.002186064s" totalImagesPullingTime="20.468948497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:54.002069139 +0000 UTC m=+23.747475549" watchObservedRunningTime="2026-08-04 09:07:54.002186064 +0000 UTC m=+23.747592483"
Aug 04 09:07:54.775625 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.775420    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:54.775903 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.775422    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:54.775903 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:54.775739    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:54.775903 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:54.775812    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:54.793981 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.793945    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:54.794540 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.794520    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:54.851445 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.851397    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:54.852150 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.851947    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pr9wb"
Aug 04 09:07:54.886853 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.886816    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jzktd" event={"ID":"0c985c47-1dde-47f0-920d-3750deed20ab","Type":"ContainerStarted","Data":"f658ea77e9d608a8bf851c347995d727cc85bd2a45d150a36254e8f65e2abd2c"}
Aug 04 09:07:54.903061 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:54.903009    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jzktd" podStartSLOduration=3.433585269 podStartE2EDuration="23.902988386s" totalImagesPullingTime="20.469403117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:54.902380231 +0000 UTC m=+24.647786642" watchObservedRunningTime="2026-08-04 09:07:54.902988386 +0000 UTC m=+24.648394797"
Aug 04 09:07:55.433813 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.433787    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 09:07:55.728948 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.728842    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T09:07:55.433810833Z","UUID":"36c1c8a8-5489-4691-8cb3-6432cb02eded","Handler":null,"Name":"","Endpoint":""}
Aug 04 09:07:55.730230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.730212    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 09:07:55.730340 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.730265    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 09:07:55.775505 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.775486    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:55.775600 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:55.775583    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:55.893661 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.893572    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"68373747a1b7cfa3c97ad7798fed7c1a1d32b96671b0b2c482ddb339b22b46f9"}
Aug 04 09:07:55.895509 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.895486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn" event={"ID":"43bed49f-5533-477d-9de5-6b9f6eb0b6c8","Type":"ContainerStarted","Data":"0fcc6575f9f3cf9af3fd37eccfc9decfa29ffef9002cd48d7030b141f2969298"}
Aug 04 09:07:55.897521 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.897496    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal" event={"ID":"6b6e89ec59b61309996e494c45807448","Type":"ContainerStarted","Data":"ef5d5d7dfdae5656d0af60604ef7799486ac9bd3f79c00375c48490d31efa89c"}
Aug 04 09:07:55.912658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:55.912620    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-202.ec2.internal" podStartSLOduration=24.912607475 podStartE2EDuration="24.912607475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:55.912473343 +0000 UTC m=+25.657879755" watchObservedRunningTime="2026-08-04 09:07:55.912607475 +0000 UTC m=+25.658013886"
Aug 04 09:07:56.775331 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:56.775299    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:56.775331 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:56.775326    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:56.775575 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:56.775439    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:56.775635 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:56.775573    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:56.901752 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:56.901717    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn" event={"ID":"43bed49f-5533-477d-9de5-6b9f6eb0b6c8","Type":"ContainerStarted","Data":"7b9f09ce5aa832a4f17a2f30883b7dc190f14aa009ffe0a590765e9417583e46"}
Aug 04 09:07:56.918798 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:56.918751    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hklfn" podStartSLOduration=2.795598796 podStartE2EDuration="25.918735988s" totalImagesPullingTime="23.123137192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:56.918372711 +0000 UTC m=+26.663779122" watchObservedRunningTime="2026-08-04 09:07:56.918735988 +0000 UTC m=+26.664142403"
Aug 04 09:07:57.775382 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:57.775345    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:57.775574 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:57.775474    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:58.775383 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:58.775350    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:07:58.775818 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:58.775506    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:07:58.775818 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:58.775549    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:07:58.776017 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:58.775992    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:07:59.775508 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.775322    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:07:59.776032 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:07:59.775588    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:07:59.910736 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.910701    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3" containerID="36fdf96354c7a5b6c07406b0bfc29e6c069cd1bbc238cca8450827ba8c6ec755" exitCode=0
Aug 04 09:07:59.910948 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.910788    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerDied","Data":"36fdf96354c7a5b6c07406b0bfc29e6c069cd1bbc238cca8450827ba8c6ec755"}
Aug 04 09:07:59.914498 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.914466    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" event={"ID":"f8242793-a448-4e49-94d6-1f0ee6166191","Type":"ContainerStarted","Data":"de0fb2cf4f793b225923969283fbeb4fa95d1dbad3894028eb3aec5e727fa73e"}
Aug 04 09:07:59.914770 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.914757    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:59.914837 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.914813    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:59.931195 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.931171    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:07:59.964175 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:07:59.964139    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf" podStartSLOduration=8.487107263 podStartE2EDuration="28.964125891s" totalImagesPullingTime="20.477018628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:07:59.963675701 +0000 UTC m=+29.709082112" watchObservedRunningTime="2026-08-04 09:07:59.964125891 +0000 UTC m=+29.709532302"
Aug 04 09:08:00.776425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:00.776396    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:00.777017 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:00.776514    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:08:00.777017 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:00.776621    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:00.777017 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:00.776735    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:08:00.916791 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:00.916750    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:08:00.931970 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:00.931946    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:08:01.250001 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.249824    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5whhp"]
Aug 04 09:08:01.250156 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.250100    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:01.250230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:01.250209    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:08:01.254196 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.254170    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zft9s"]
Aug 04 09:08:01.254360 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.254290    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:08:01.254431 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:01.254400    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:08:01.254867 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.254845    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gph88"]
Aug 04 09:08:01.254967 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.254927    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:01.255024 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:01.255002    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:08:01.920589 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.920552    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3" containerID="e4edd0296c10d0f1d06b28642702f8baa2a45fb0cdf3384e8badf0fcdd845c0f" exitCode=0
Aug 04 09:08:01.921059 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:01.920637    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerDied","Data":"e4edd0296c10d0f1d06b28642702f8baa2a45fb0cdf3384e8badf0fcdd845c0f"}
Aug 04 09:08:02.775414 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:02.775378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:02.775638 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:02.775378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:02.775638 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:02.775529    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:08:02.775638 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:02.775378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:08:02.775638 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:02.775611    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:08:02.775837 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:02.775665    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:08:03.433078 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:03.432992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:03.433078 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:03.433039    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:03.433078 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:03.433062    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433144    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433149    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433161    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433181    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433191    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nd94k for pod openshift-network-diagnostics/network-check-target-gph88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433209    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:35.433192745 +0000 UTC m=+65.178599151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433221    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret podName:cbcb9552-fcb4-4a61-8686-311e5c65e2a3 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:35.433215836 +0000 UTC m=+65.178622224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret") pod "global-pull-secret-syncer-5whhp" (UID: "cbcb9552-fcb4-4a61-8686-311e5c65e2a3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 09:08:03.433546 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:03.433231    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k podName:cccde668-6515-486f-a053-e9471621ea90 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:35.433225757 +0000 UTC m=+65.178632146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd94k" (UniqueName: "kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k") pod "network-check-target-gph88" (UID: "cccde668-6515-486f-a053-e9471621ea90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 09:08:03.927252 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:03.927214    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3" containerID="aec699c322984b222736c6335bcfd2acc11d6a8ef4bc000d3083fec65d0f9873" exitCode=0
Aug 04 09:08:03.927417 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:03.927280    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerDied","Data":"aec699c322984b222736c6335bcfd2acc11d6a8ef4bc000d3083fec65d0f9873"}
Aug 04 09:08:04.775232 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:04.775201    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:04.775699 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:04.775315    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gph88" podUID="cccde668-6515-486f-a053-e9471621ea90"
Aug 04 09:08:04.775699 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:04.775204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:08:04.775699 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:04.775364    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:04.775699 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:04.775428    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zft9s" podUID="808a8f84-514c-4f38-b761-2c3375d70ec0"
Aug 04 09:08:04.775699 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:04.775530    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5whhp" podUID="cbcb9552-fcb4-4a61-8686-311e5c65e2a3"
Aug 04 09:08:05.542139 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.542112    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-202.ec2.internal" event="NodeReady"
Aug 04 09:08:05.542304 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.542270    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 09:08:05.581228 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.581195    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65f9bdbc4-m87rt"]
Aug 04 09:08:05.583488 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.583450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.586639 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.586609    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 09:08:05.587215 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.586977    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 09:08:05.587215 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.587164    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 09:08:05.587485 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.587372    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-27s78\""
Aug 04 09:08:05.597384 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.597352    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 09:08:05.597518 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.597427    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dl7rg"]
Aug 04 09:08:05.600482 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.600408    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"]
Aug 04 09:08:05.601481 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.601446    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.602393 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.602375    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.603365 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.602568    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-p29gj"]
Aug 04 09:08:05.604415 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.604397    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"]
Aug 04 09:08:05.604716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.604694    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.606034 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.606015    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 09:08:05.606212 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.606191    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.607162 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.607138    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-rzs4h"]
Aug 04 09:08:05.607503 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.607483    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:05.608111 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.608095    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 09:08:05.608380 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.608358    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.608590 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.608573    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 04 09:08:05.608708 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.608687    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 04 09:08:05.608945 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.608874    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ck9gd\""
Aug 04 09:08:05.609208 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.609192    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-d7f49d6c4-92bh4"]
Aug 04 09:08:05.609332 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.609315    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.610023 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.610003    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.610289 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.610273    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qqnnd\""
Aug 04 09:08:05.610495 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.610410    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.610495 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.610487    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7xnmk\""
Aug 04 09:08:05.610626 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.610610    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 04 09:08:05.610785 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.610766    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 04 09:08:05.610997 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.610977    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.611535 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.611519    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"]
Aug 04 09:08:05.611638 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.611624    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.613414 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.613348    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"]
Aug 04 09:08:05.613730 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.613712    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 04 09:08:05.613811 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.613786    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.613864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.613847    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-56ngf\""
Aug 04 09:08:05.613931 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.613918    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.614006 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.613993    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 04 09:08:05.614138 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.614126    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"
Aug 04 09:08:05.614198 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.614183    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 04 09:08:05.614233 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.614214    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xfgq4\""
Aug 04 09:08:05.614264 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.614246    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.614837 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.614818    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.615076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.615056    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 04 09:08:05.615076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.615071    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"]
Aug 04 09:08:05.615258 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.615189    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.615810 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.615752    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 04 09:08:05.616042 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.615832    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 04 09:08:05.616551 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.616161    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.616551 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.616365    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 04 09:08:05.617137 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.617117    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-plzkf\""
Aug 04 09:08:05.617407 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.617389    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65f9bdbc4-m87rt"]
Aug 04 09:08:05.617521 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.617498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.618650 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.618501    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.619388 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.619371    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.620560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.620540    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kb4tw\""
Aug 04 09:08:05.621981 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.621962    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 04 09:08:05.622301 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.622280    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 04 09:08:05.622716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.622600    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.622716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.622604    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 04 09:08:05.623176 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.623158    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.623591 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.623540    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.623841 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.623567    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 04 09:08:05.628889 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.628820    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-d2d5t\""
Aug 04 09:08:05.631107 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.630886    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"]
Aug 04 09:08:05.631107 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.631092    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dl7rg"]
Aug 04 09:08:05.635560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.632574    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.635560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.633091    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 04 09:08:05.635560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.633606    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2tpjn\""
Aug 04 09:08:05.635769 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.635621    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 04 09:08:05.639099 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.639080    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rzs4h"]
Aug 04 09:08:05.639989 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.639967    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"]
Aug 04 09:08:05.642843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.642823    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"]
Aug 04 09:08:05.643218 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.643200    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:05.646531 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.646499    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"]
Aug 04 09:08:05.646623 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.646548    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"]
Aug 04 09:08:05.646623 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.646583    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"]
Aug 04 09:08:05.646726 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.646685    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.649563 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.649545    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"]
Aug 04 09:08:05.650040 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.649811    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"
Aug 04 09:08:05.650965 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.650944    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 09:08:05.650965 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.650961    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.651263 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.651212    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 04 09:08:05.651263 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.651234    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 04 09:08:05.651390 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.651342    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 04 09:08:05.651524 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.651395    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.651524 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.651515    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 04 09:08:05.651744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.651728    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-b25np\""
Aug 04 09:08:05.652262 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.651938    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 04 09:08:05.652361 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.652305    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zn4vx"]
Aug 04 09:08:05.652515 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.652496    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.653507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.653488    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5qbj5\""
Aug 04 09:08:05.653651 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.653526    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.653651 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.653636    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.654725 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.654706    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"]
Aug 04 09:08:05.654948 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.654932    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-p29gj"]
Aug 04 09:08:05.655150 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.655135    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"]
Aug 04 09:08:05.655270 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.655260    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zn4vx"]
Aug 04 09:08:05.655374 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.655363    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"]
Aug 04 09:08:05.655504 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.655492    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"]
Aug 04 09:08:05.655674 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.654765    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:05.659400 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.659381    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 09:08:05.659754 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.659480    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 09:08:05.659877 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.659527    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"]
Aug 04 09:08:05.659949 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.659593    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 09:08:05.660057 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.659647    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 04 09:08:05.660190 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.659655    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lkd2q\""
Aug 04 09:08:05.661164 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.661143    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"]
Aug 04 09:08:05.662612 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.662588    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d7f49d6c4-92bh4"]
Aug 04 09:08:05.750954 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.750928    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhklm\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-kube-api-access-zhklm\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.751067 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.750960    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp6nh\" (UniqueName: \"kubernetes.io/projected/20990dc9-a395-49da-a3d7-b2a551bdf42a-kube-api-access-hp6nh\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:05.751067 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.750985    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10fd3f18-b85e-4ffb-827a-f8e28dda9609-serving-cert\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.751067 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751030    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-stats-auth\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.751244 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751078    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5737b403-f4dc-47d1-b71b-894f7a414920-serving-cert\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.751244 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751109    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10fd3f18-b85e-4ffb-827a-f8e28dda9609-config\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.751244 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751157    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hstj7\" (UniqueName: \"kubernetes.io/projected/62ae4795-910a-40bd-b809-3c03901ae840-kube-api-access-hstj7\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.751244 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751212    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751247    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llfp9\" (UniqueName: \"kubernetes.io/projected/357194bb-769b-4cfa-ad63-a5a88e46d580-kube-api-access-llfp9\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751286    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-trusted-ca\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751329    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96303cf3-7177-4101-98e9-7f7b7e13ad6f-trusted-ca-bundle\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751355    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357194bb-769b-4cfa-ad63-a5a88e46d580-tmp-dir\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751378    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ae4795-910a-40bd-b809-3c03901ae840-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ae4795-910a-40bd-b809-3c03901ae840-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.751432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751409    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751442    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-ca\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751481    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjtfn\" (UniqueName: \"kubernetes.io/projected/399fb17d-fe90-4391-92ea-cb891aa88f9f-kube-api-access-bjtfn\") pod \"ingress-canary-zn4vx\" (UID: \"399fb17d-fe90-4391-92ea-cb891aa88f9f\") " pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751524    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-hub\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751552    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4391252-51fd-457a-9b90-f4cde5d9bd49-ca-trust-extracted\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751602    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96303cf3-7177-4101-98e9-7f7b7e13ad6f-snapshots\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751649    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96303cf3-7177-4101-98e9-7f7b7e13ad6f-serving-cert\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751675    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5737b403-f4dc-47d1-b71b-894f7a414920-trusted-ca\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751699    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-tmp\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751713    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-image-registry-private-configuration\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751730    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-certificates\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.751780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751746    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/399fb17d-fe90-4391-92ea-cb891aa88f9f-cert\") pod \"ingress-canary-zn4vx\" (UID: \"399fb17d-fe90-4391-92ea-cb891aa88f9f\") " pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:05.752204 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751765    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks7m5\" (UniqueName: \"kubernetes.io/projected/96303cf3-7177-4101-98e9-7f7b7e13ad6f-kube-api-access-ks7m5\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.752204 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751817    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-default-certificate\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.752204 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.751840    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.752204 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752026    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhjbc\" (UniqueName: \"kubernetes.io/projected/d592a7b2-418a-412c-8632-e5c4fb4584e9-kube-api-access-zhjbc\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.752204 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752084    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d592a7b2-418a-412c-8632-e5c4fb4584e9-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.752204 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752109    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.752204 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752173    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:05.752522 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752212    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.752522 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752242    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck2nh\" (UniqueName: \"kubernetes.io/projected/7af690d5-49cb-4bc8-b076-f0b5e4dda6ef-kube-api-access-ck2nh\") pod \"network-check-source-65bdbbff45-jx72h\" (UID: \"7af690d5-49cb-4bc8-b076-f0b5e4dda6ef\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"
Aug 04 09:08:05.752522 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752275    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-installation-pull-secrets\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.752522 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752343    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d682749-b1f3-48ea-8620-e9c71db5a38b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7994946696-9zjmh\" (UID: \"7d682749-b1f3-48ea-8620-e9c71db5a38b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:05.752696 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752522    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fcmr\" (UniqueName: \"kubernetes.io/projected/65c21b83-7cb4-4954-ba10-aef3bb1abc89-kube-api-access-6fcmr\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.752696 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752622    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96303cf3-7177-4101-98e9-7f7b7e13ad6f-service-ca-bundle\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.752785 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752706    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc85j\" (UniqueName: \"kubernetes.io/projected/7d682749-b1f3-48ea-8620-e9c71db5a38b-kube-api-access-lc85j\") pod \"managed-serviceaccount-addon-agent-7994946696-9zjmh\" (UID: \"7d682749-b1f3-48ea-8620-e9c71db5a38b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:05.752785 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752772    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/357194bb-769b-4cfa-ad63-a5a88e46d580-config-volume\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.752874 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752810    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6hr\" (UniqueName: \"kubernetes.io/projected/10fd3f18-b85e-4ffb-827a-f8e28dda9609-kube-api-access-9n6hr\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.752874 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752868    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96303cf3-7177-4101-98e9-7f7b7e13ad6f-tmp\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.752967 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752930    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pjp2\" (UniqueName: \"kubernetes.io/projected/5737b403-f4dc-47d1-b71b-894f7a414920-kube-api-access-8pjp2\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.753014 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.752978    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c21b83-7cb4-4954-ba10-aef3bb1abc89-additional-service-ca\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.753062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.753008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htb2q\" (UniqueName: \"kubernetes.io/projected/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-kube-api-access-htb2q\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.753104 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.753065    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-bound-sa-token\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.753150 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.753099    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5737b403-f4dc-47d1-b71b-894f7a414920-config\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.753199 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.753159    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.753249 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.753211    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.753293 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.753265    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4xjv\" (UniqueName: \"kubernetes.io/projected/0d44f5ad-d07b-485e-8422-e74daaf5324c-kube-api-access-f4xjv\") pod \"volume-data-source-validator-5b8776669-5nc8g\" (UID: \"0d44f5ad-d07b-485e-8422-e74daaf5324c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"
Aug 04 09:08:05.753340 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.753295    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmh6k\" (UniqueName: \"kubernetes.io/projected/224cdd14-b33f-4cbb-a3e5-252e312cc879-kube-api-access-nmh6k\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.853893 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.853861    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.853900    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.853919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4xjv\" (UniqueName: \"kubernetes.io/projected/0d44f5ad-d07b-485e-8422-e74daaf5324c-kube-api-access-f4xjv\") pod \"volume-data-source-validator-5b8776669-5nc8g\" (UID: \"0d44f5ad-d07b-485e-8422-e74daaf5324c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.853942    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmh6k\" (UniqueName: \"kubernetes.io/projected/224cdd14-b33f-4cbb-a3e5-252e312cc879-kube-api-access-nmh6k\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854003    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhklm\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-kube-api-access-zhklm\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854030    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp6nh\" (UniqueName: \"kubernetes.io/projected/20990dc9-a395-49da-a3d7-b2a551bdf42a-kube-api-access-hp6nh\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.854031    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.854055    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f9bdbc4-m87rt: secret "image-registry-tls" not found
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854056    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10fd3f18-b85e-4ffb-827a-f8e28dda9609-serving-cert\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-stats-auth\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854109    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5737b403-f4dc-47d1-b71b-894f7a414920-serving-cert\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854137    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10fd3f18-b85e-4ffb-827a-f8e28dda9609-config\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854166    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hstj7\" (UniqueName: \"kubernetes.io/projected/62ae4795-910a-40bd-b809-3c03901ae840-kube-api-access-hstj7\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854200    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854225    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llfp9\" (UniqueName: \"kubernetes.io/projected/357194bb-769b-4cfa-ad63-a5a88e46d580-kube-api-access-llfp9\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.854249    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls podName:c4391252-51fd-457a-9b90-f4cde5d9bd49 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:06.354231033 +0000 UTC m=+36.099637427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls") pod "image-registry-65f9bdbc4-m87rt" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49") : secret "image-registry-tls" not found
Aug 04 09:08:05.854341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854299    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854329    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-trusted-ca\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854363    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96303cf3-7177-4101-98e9-7f7b7e13ad6f-trusted-ca-bundle\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854391    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357194bb-769b-4cfa-ad63-a5a88e46d580-tmp-dir\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.854430    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854434    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ae4795-910a-40bd-b809-3c03901ae840-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854483    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ae4795-910a-40bd-b809-3c03901ae840-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.854519    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls podName:d592a7b2-418a-412c-8632-e5c4fb4584e9 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:06.354498374 +0000 UTC m=+36.099904762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-jnr8f" (UID: "d592a7b2-418a-412c-8632-e5c4fb4584e9") : secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854556    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854585    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-ca\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854630    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjtfn\" (UniqueName: \"kubernetes.io/projected/399fb17d-fe90-4391-92ea-cb891aa88f9f-kube-api-access-bjtfn\") pod \"ingress-canary-zn4vx\" (UID: \"399fb17d-fe90-4391-92ea-cb891aa88f9f\") " pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854656    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-hub\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4391252-51fd-457a-9b90-f4cde5d9bd49-ca-trust-extracted\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96303cf3-7177-4101-98e9-7f7b7e13ad6f-snapshots\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854725    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96303cf3-7177-4101-98e9-7f7b7e13ad6f-serving-cert\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.854748    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5737b403-f4dc-47d1-b71b-894f7a414920-trusted-ca\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.855090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855086    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357194bb-769b-4cfa-ad63-a5a88e46d580-tmp-dir\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855136    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-tmp\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855172    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-image-registry-private-configuration\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855201    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-certificates\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855238    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/399fb17d-fe90-4391-92ea-cb891aa88f9f-cert\") pod \"ingress-canary-zn4vx\" (UID: \"399fb17d-fe90-4391-92ea-cb891aa88f9f\") " pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855265    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks7m5\" (UniqueName: \"kubernetes.io/projected/96303cf3-7177-4101-98e9-7f7b7e13ad6f-kube-api-access-ks7m5\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855296    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-default-certificate\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855322    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855351    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhjbc\" (UniqueName: \"kubernetes.io/projected/d592a7b2-418a-412c-8632-e5c4fb4584e9-kube-api-access-zhjbc\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855385    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d592a7b2-418a-412c-8632-e5c4fb4584e9-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855387    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96303cf3-7177-4101-98e9-7f7b7e13ad6f-trusted-ca-bundle\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855404    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-trusted-ca\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855412    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.855780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855587    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5737b403-f4dc-47d1-b71b-894f7a414920-trusted-ca\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.856379 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.855901    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-tmp\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.856379 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.856113    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ae4795-910a-40bd-b809-3c03901ae840-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.856763 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.856740    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:05.859420 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859394    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.859420 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859439    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck2nh\" (UniqueName: \"kubernetes.io/projected/7af690d5-49cb-4bc8-b076-f0b5e4dda6ef-kube-api-access-ck2nh\") pod \"network-check-source-65bdbbff45-jx72h\" (UID: \"7af690d5-49cb-4bc8-b076-f0b5e4dda6ef\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"
Aug 04 09:08:05.859657 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859490    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-installation-pull-secrets\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.859657 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859516    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d682749-b1f3-48ea-8620-e9c71db5a38b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7994946696-9zjmh\" (UID: \"7d682749-b1f3-48ea-8620-e9c71db5a38b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:05.859657 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859545    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fcmr\" (UniqueName: \"kubernetes.io/projected/65c21b83-7cb4-4954-ba10-aef3bb1abc89-kube-api-access-6fcmr\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.859657 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859591    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96303cf3-7177-4101-98e9-7f7b7e13ad6f-service-ca-bundle\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.859657 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859628    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc85j\" (UniqueName: \"kubernetes.io/projected/7d682749-b1f3-48ea-8620-e9c71db5a38b-kube-api-access-lc85j\") pod \"managed-serviceaccount-addon-agent-7994946696-9zjmh\" (UID: \"7d682749-b1f3-48ea-8620-e9c71db5a38b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859659    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/357194bb-769b-4cfa-ad63-a5a88e46d580-config-volume\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859679    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4391252-51fd-457a-9b90-f4cde5d9bd49-ca-trust-extracted\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859694    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6hr\" (UniqueName: \"kubernetes.io/projected/10fd3f18-b85e-4ffb-827a-f8e28dda9609-kube-api-access-9n6hr\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859731    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96303cf3-7177-4101-98e9-7f7b7e13ad6f-tmp\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859762    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pjp2\" (UniqueName: \"kubernetes.io/projected/5737b403-f4dc-47d1-b71b-894f7a414920-kube-api-access-8pjp2\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c21b83-7cb4-4954-ba10-aef3bb1abc89-additional-service-ca\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859819    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htb2q\" (UniqueName: \"kubernetes.io/projected/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-kube-api-access-htb2q\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859844    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-bound-sa-token\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.860045 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.859870    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5737b403-f4dc-47d1-b71b-894f7a414920-config\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.860650 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.860534    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5737b403-f4dc-47d1-b71b-894f7a414920-config\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.860650 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.856927    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 09:08:05.860650 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.860628    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls podName:20990dc9-a395-49da-a3d7-b2a551bdf42a nodeName:}" failed. No retries permitted until 2026-08-04 09:08:06.360611729 +0000 UTC m=+36.106018120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-w77xt" (UID: "20990dc9-a395-49da-a3d7-b2a551bdf42a") : secret "samples-operator-tls" not found
Aug 04 09:08:05.860850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.860668    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10fd3f18-b85e-4ffb-827a-f8e28dda9609-config\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.860850 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.860705    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:06.360694184 +0000 UTC m=+36.106100587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : configmap references non-existent config key: service-ca.crt
Aug 04 09:08:05.860850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.857542    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-certificates\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.861117 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.860901    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 09:08:05.861117 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.857756    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d592a7b2-418a-412c-8632-e5c4fb4584e9-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.861117 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.860963    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls podName:357194bb-769b-4cfa-ad63-a5a88e46d580 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:06.360947162 +0000 UTC m=+36.106353567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls") pod "dns-default-dl7rg" (UID: "357194bb-769b-4cfa-ad63-a5a88e46d580") : secret "dns-default-metrics-tls" not found
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.861447    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:05.861559    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:06.361543561 +0000 UTC m=+36.106949953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : secret "router-metrics-certs-default" not found
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.861570    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.861592    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96303cf3-7177-4101-98e9-7f7b7e13ad6f-snapshots\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.861763    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10fd3f18-b85e-4ffb-827a-f8e28dda9609-serving-cert\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.862311    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-image-registry-private-configuration\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.862638    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c21b83-7cb4-4954-ba10-aef3bb1abc89-additional-service-ca\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.862691    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96303cf3-7177-4101-98e9-7f7b7e13ad6f-service-ca-bundle\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.862880    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96303cf3-7177-4101-98e9-7f7b7e13ad6f-tmp\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.863264    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/357194bb-769b-4cfa-ad63-a5a88e46d580-config-volume\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.863556 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.863552    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.864799 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.864491    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d682749-b1f3-48ea-8620-e9c71db5a38b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7994946696-9zjmh\" (UID: \"7d682749-b1f3-48ea-8620-e9c71db5a38b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:05.864886 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.864831    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-default-certificate\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.865317 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.864995    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-stats-auth\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.865546 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.865482    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-installation-pull-secrets\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.866867 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.866840    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.867489 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.867446    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-hub\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.870081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.867915    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4xjv\" (UniqueName: \"kubernetes.io/projected/0d44f5ad-d07b-485e-8422-e74daaf5324c-kube-api-access-f4xjv\") pod \"volume-data-source-validator-5b8776669-5nc8g\" (UID: \"0d44f5ad-d07b-485e-8422-e74daaf5324c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"
Aug 04 09:08:05.870081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.868793    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ae4795-910a-40bd-b809-3c03901ae840-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.870081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.870005    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhklm\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-kube-api-access-zhklm\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.870081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.870005    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp6nh\" (UniqueName: \"kubernetes.io/projected/20990dc9-a395-49da-a3d7-b2a551bdf42a-kube-api-access-hp6nh\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:05.870341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.870209    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmh6k\" (UniqueName: \"kubernetes.io/projected/224cdd14-b33f-4cbb-a3e5-252e312cc879-kube-api-access-nmh6k\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:05.870341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.870334    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96303cf3-7177-4101-98e9-7f7b7e13ad6f-serving-cert\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.870796 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.870771    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/399fb17d-fe90-4391-92ea-cb891aa88f9f-cert\") pod \"ingress-canary-zn4vx\" (UID: \"399fb17d-fe90-4391-92ea-cb891aa88f9f\") " pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:05.870956 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.870926    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llfp9\" (UniqueName: \"kubernetes.io/projected/357194bb-769b-4cfa-ad63-a5a88e46d580-kube-api-access-llfp9\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:05.872174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.872119    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks7m5\" (UniqueName: \"kubernetes.io/projected/96303cf3-7177-4101-98e9-7f7b7e13ad6f-kube-api-access-ks7m5\") pod \"insights-operator-77696685b-rzs4h\" (UID: \"96303cf3-7177-4101-98e9-7f7b7e13ad6f\") " pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.873143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.872907    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhjbc\" (UniqueName: \"kubernetes.io/projected/d592a7b2-418a-412c-8632-e5c4fb4584e9-kube-api-access-zhjbc\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:05.873143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.872927    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5737b403-f4dc-47d1-b71b-894f7a414920-serving-cert\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.873143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.873106    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65c21b83-7cb4-4954-ba10-aef3bb1abc89-ca\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.875797 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.875776    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjtfn\" (UniqueName: \"kubernetes.io/projected/399fb17d-fe90-4391-92ea-cb891aa88f9f-kube-api-access-bjtfn\") pod \"ingress-canary-zn4vx\" (UID: \"399fb17d-fe90-4391-92ea-cb891aa88f9f\") " pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:05.876910 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.876883    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6hr\" (UniqueName: \"kubernetes.io/projected/10fd3f18-b85e-4ffb-827a-f8e28dda9609-kube-api-access-9n6hr\") pod \"service-ca-operator-784f97bcf6-j4ws5\" (UID: \"10fd3f18-b85e-4ffb-827a-f8e28dda9609\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:05.877094 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.877062    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hstj7\" (UniqueName: \"kubernetes.io/projected/62ae4795-910a-40bd-b809-3c03901ae840-kube-api-access-hstj7\") pod \"kube-storage-version-migrator-operator-7878f4b88c-bx482\" (UID: \"62ae4795-910a-40bd-b809-3c03901ae840\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.880096 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.880073    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pjp2\" (UniqueName: \"kubernetes.io/projected/5737b403-f4dc-47d1-b71b-894f7a414920-kube-api-access-8pjp2\") pod \"console-operator-5ccd6b445f-p29gj\" (UID: \"5737b403-f4dc-47d1-b71b-894f7a414920\") " pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.881200 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.880530    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-bound-sa-token\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:05.881200 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.880795    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fcmr\" (UniqueName: \"kubernetes.io/projected/65c21b83-7cb4-4954-ba10-aef3bb1abc89-kube-api-access-6fcmr\") pod \"cluster-proxy-proxy-agent-757d79f49b-gxp7l\" (UID: \"65c21b83-7cb4-4954-ba10-aef3bb1abc89\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:05.881200 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.881161    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck2nh\" (UniqueName: \"kubernetes.io/projected/7af690d5-49cb-4bc8-b076-f0b5e4dda6ef-kube-api-access-ck2nh\") pod \"network-check-source-65bdbbff45-jx72h\" (UID: \"7af690d5-49cb-4bc8-b076-f0b5e4dda6ef\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"
Aug 04 09:08:05.881539 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.881518    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htb2q\" (UniqueName: \"kubernetes.io/projected/b240883c-8d1a-4b5f-aa75-5d0d0e354e97-kube-api-access-htb2q\") pod \"klusterlet-addon-workmgr-7ffd8fc7df-qdxkn\" (UID: \"b240883c-8d1a-4b5f-aa75-5d0d0e354e97\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:05.881808 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.881787    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc85j\" (UniqueName: \"kubernetes.io/projected/7d682749-b1f3-48ea-8620-e9c71db5a38b-kube-api-access-lc85j\") pod \"managed-serviceaccount-addon-agent-7994946696-9zjmh\" (UID: \"7d682749-b1f3-48ea-8620-e9c71db5a38b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:05.894899 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.894850    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:05.922208 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.922177    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"
Aug 04 09:08:05.941343 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.941315    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:05.954285 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.954076    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rzs4h"
Aug 04 09:08:05.971434 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.970482    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"
Aug 04 09:08:05.976897 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:05.976705    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"
Aug 04 09:08:06.000718 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.000692    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"
Aug 04 09:08:06.006719 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.006445    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:08:06.007590 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.007536    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:06.013037 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.012628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"
Aug 04 09:08:06.026913 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.026652    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:06.038032 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.037686    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zn4vx"
Aug 04 09:08:06.189224 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.187101    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482"]
Aug 04 09:08:06.208972 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:06.198052    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ae4795_910a_40bd_b809_3c03901ae840.slice/crio-d546e1b7fc3aa50b4a9e5eb8aa9ccf3ba945b750ce4ec747ff6f5891067786d5 WatchSource:0}: Error finding container d546e1b7fc3aa50b4a9e5eb8aa9ccf3ba945b750ce4ec747ff6f5891067786d5: Status 404 returned error can't find the container with id d546e1b7fc3aa50b4a9e5eb8aa9ccf3ba945b750ce4ec747ff6f5891067786d5
Aug 04 09:08:06.208972 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.200854    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rzs4h"]
Aug 04 09:08:06.227425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.227358    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-p29gj"]
Aug 04 09:08:06.271070 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.271037    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5"]
Aug 04 09:08:06.282843 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:06.282789    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fd3f18_b85e_4ffb_827a_f8e28dda9609.slice/crio-9552248b4208e6080fd47db77f3f866475a900f1672e798a0216d45494a0bf3c WatchSource:0}: Error finding container 9552248b4208e6080fd47db77f3f866475a900f1672e798a0216d45494a0bf3c: Status 404 returned error can't find the container with id 9552248b4208e6080fd47db77f3f866475a900f1672e798a0216d45494a0bf3c
Aug 04 09:08:06.283725 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.283536    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"]
Aug 04 09:08:06.298881 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.295582    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g"]
Aug 04 09:08:06.298881 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:06.298269    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d44f5ad_d07b_485e_8422_e74daaf5324c.slice/crio-125b420a7a2682a9efe82e6fab4e7c885df99accc0f8efb35c86ac0d98cb5ae6 WatchSource:0}: Error finding container 125b420a7a2682a9efe82e6fab4e7c885df99accc0f8efb35c86ac0d98cb5ae6: Status 404 returned error can't find the container with id 125b420a7a2682a9efe82e6fab4e7c885df99accc0f8efb35c86ac0d98cb5ae6
Aug 04 09:08:06.304709 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.304644    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h"]
Aug 04 09:08:06.330232 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.330103    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh"]
Aug 04 09:08:06.332737 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:06.332707    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d682749_b1f3_48ea_8620_e9c71db5a38b.slice/crio-fb9f08d14fb8000ee9a254288b512aaec9e020942a60bb9eeda47f17ffc1d1f1 WatchSource:0}: Error finding container fb9f08d14fb8000ee9a254288b512aaec9e020942a60bb9eeda47f17ffc1d1f1: Status 404 returned error can't find the container with id fb9f08d14fb8000ee9a254288b512aaec9e020942a60bb9eeda47f17ffc1d1f1
Aug 04 09:08:06.349212 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.349182    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zn4vx"]
Aug 04 09:08:06.352193 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:06.352164    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399fb17d_fe90_4391_92ea_cb891aa88f9f.slice/crio-39bf59fa232415e61d0081db27edab60c4191b6a967556013b6098530e579d50 WatchSource:0}: Error finding container 39bf59fa232415e61d0081db27edab60c4191b6a967556013b6098530e579d50: Status 404 returned error can't find the container with id 39bf59fa232415e61d0081db27edab60c4191b6a967556013b6098530e579d50
Aug 04 09:08:06.361562 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.361529    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"]
Aug 04 09:08:06.363495 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:06.363366    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb240883c_8d1a_4b5f_aa75_5d0d0e354e97.slice/crio-ea0fffa51014b286e6a8179b89aa8645f7e3a9fc4f3c053079b8098eb580f9f2 WatchSource:0}: Error finding container ea0fffa51014b286e6a8179b89aa8645f7e3a9fc4f3c053079b8098eb580f9f2: Status 404 returned error can't find the container with id ea0fffa51014b286e6a8179b89aa8645f7e3a9fc4f3c053079b8098eb580f9f2
Aug 04 09:08:06.364904 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.364880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:06.364999 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.364956    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:06.364999 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.364990    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:06.365110 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.365046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:06.365110 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.365089    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:06.365110 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365094    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 09:08:06.365266 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365113    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f9bdbc4-m87rt: secret "image-registry-tls" not found
Aug 04 09:08:06.365266 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.365119    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:06.365266 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365163    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls podName:c4391252-51fd-457a-9b90-f4cde5d9bd49 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:07.365145585 +0000 UTC m=+37.110551993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls") pod "image-registry-65f9bdbc4-m87rt" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49") : secret "image-registry-tls" not found
Aug 04 09:08:06.365266 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365256    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:07.365239971 +0000 UTC m=+37.110646379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : configmap references non-existent config key: service-ca.crt
Aug 04 09:08:06.365482 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365334    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 09:08:06.365482 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365367    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls podName:357194bb-769b-4cfa-ad63-a5a88e46d580 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:07.365355269 +0000 UTC m=+37.110761660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls") pod "dns-default-dl7rg" (UID: "357194bb-769b-4cfa-ad63-a5a88e46d580") : secret "dns-default-metrics-tls" not found
Aug 04 09:08:06.365482 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365426    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:06.365482 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365477    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls podName:d592a7b2-418a-412c-8632-e5c4fb4584e9 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:07.365448076 +0000 UTC m=+37.110854481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-jnr8f" (UID: "d592a7b2-418a-412c-8632-e5c4fb4584e9") : secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:06.365699 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365541    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 09:08:06.365699 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365551    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 09:08:06.365699 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365571    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls podName:20990dc9-a395-49da-a3d7-b2a551bdf42a nodeName:}" failed. No retries permitted until 2026-08-04 09:08:07.36556113 +0000 UTC m=+37.110967521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-w77xt" (UID: "20990dc9-a395-49da-a3d7-b2a551bdf42a") : secret "samples-operator-tls" not found
Aug 04 09:08:06.365699 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:06.365592    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:07.365579569 +0000 UTC m=+37.110985990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : secret "router-metrics-certs-default" not found
Aug 04 09:08:06.463565 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.463484    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:06.776274 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.776196    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:06.776274 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.776196    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:06.776524 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.776197    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:08:06.779767 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.779582    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 09:08:06.780804 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.780781    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jr9km\""
Aug 04 09:08:06.781076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.781009    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 09:08:06.781286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.781173    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djwk2\""
Aug 04 09:08:06.938317 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.938262    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh" event={"ID":"7d682749-b1f3-48ea-8620-e9c71db5a38b","Type":"ContainerStarted","Data":"fb9f08d14fb8000ee9a254288b512aaec9e020942a60bb9eeda47f17ffc1d1f1"}
Aug 04 09:08:06.940205 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.940176    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5" event={"ID":"10fd3f18-b85e-4ffb-827a-f8e28dda9609","Type":"ContainerStarted","Data":"9552248b4208e6080fd47db77f3f866475a900f1672e798a0216d45494a0bf3c"}
Aug 04 09:08:06.943595 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.943532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" event={"ID":"65c21b83-7cb4-4954-ba10-aef3bb1abc89","Type":"ContainerStarted","Data":"facf62551786b4bde42a499b3990291ffe02cd17c5d0f4c0e3667b4afca056f0"}
Aug 04 09:08:06.949325 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.949291    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rzs4h" event={"ID":"96303cf3-7177-4101-98e9-7f7b7e13ad6f","Type":"ContainerStarted","Data":"1d515434af3e270ac11ab388839f9e616b521359b2606376638d2b145458c5e7"}
Aug 04 09:08:06.951787 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.951765    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" event={"ID":"5737b403-f4dc-47d1-b71b-894f7a414920","Type":"ContainerStarted","Data":"729129ebe034f1364094fcb0cf4dab9773b9a511e0f42afddfcf5baed92ce836"}
Aug 04 09:08:06.955437 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.955410    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482" event={"ID":"62ae4795-910a-40bd-b809-3c03901ae840","Type":"ContainerStarted","Data":"d546e1b7fc3aa50b4a9e5eb8aa9ccf3ba945b750ce4ec747ff6f5891067786d5"}
Aug 04 09:08:06.957064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.956993    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn" event={"ID":"b240883c-8d1a-4b5f-aa75-5d0d0e354e97","Type":"ContainerStarted","Data":"ea0fffa51014b286e6a8179b89aa8645f7e3a9fc4f3c053079b8098eb580f9f2"}
Aug 04 09:08:06.958350 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.958300    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g" event={"ID":"0d44f5ad-d07b-485e-8422-e74daaf5324c","Type":"ContainerStarted","Data":"125b420a7a2682a9efe82e6fab4e7c885df99accc0f8efb35c86ac0d98cb5ae6"}
Aug 04 09:08:06.960306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.960231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h" event={"ID":"7af690d5-49cb-4bc8-b076-f0b5e4dda6ef","Type":"ContainerStarted","Data":"05c339ba51e170e8704287a0be44cdc746fba88eb744a0b7e37d7c42f269380c"}
Aug 04 09:08:06.961933 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.961881    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zn4vx" event={"ID":"399fb17d-fe90-4391-92ea-cb891aa88f9f","Type":"ContainerStarted","Data":"39bf59fa232415e61d0081db27edab60c4191b6a967556013b6098530e579d50"}
Aug 04 09:08:06.993609 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.992423    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-56shw"]
Aug 04 09:08:06.995306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.994690    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:06.997257 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.997239    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 04 09:08:06.997876 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.997665    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 04 09:08:06.998821 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:06.998353    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qmmsr\""
Aug 04 09:08:07.006923 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.006819    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-56shw"]
Aug 04 09:08:07.110231 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.110171    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:07.174314 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.174039    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b7fb4639-25ba-4de9-a479-50e30ff21bb5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:07.174314 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.174121    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:07.193618 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.193533    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:07.275068 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.275031    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b7fb4639-25ba-4de9-a479-50e30ff21bb5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:07.275254 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.275127    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:07.275333 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.275312    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 09:08:07.275510 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.275379    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert podName:b7fb4639-25ba-4de9-a479-50e30ff21bb5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:07.775359874 +0000 UTC m=+37.520766276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-56shw" (UID: "b7fb4639-25ba-4de9-a479-50e30ff21bb5") : secret "networking-console-plugin-cert" not found
Aug 04 09:08:07.276281 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.276227    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b7fb4639-25ba-4de9-a479-50e30ff21bb5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:07.296257 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.296203    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:07.376517 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.376418    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:07.376671 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.376538    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:07.376671 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.376606    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:07.376671 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.376642    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:07.376843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.376703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:07.376843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.376745    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:07.376941 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.376869    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 09:08:07.376941 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.376930    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls podName:20990dc9-a395-49da-a3d7-b2a551bdf42a nodeName:}" failed. No retries permitted until 2026-08-04 09:08:09.376913266 +0000 UTC m=+39.122319663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-w77xt" (UID: "20990dc9-a395-49da-a3d7-b2a551bdf42a") : secret "samples-operator-tls" not found
Aug 04 09:08:07.377355 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.377337    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:09.377321652 +0000 UTC m=+39.122728045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : configmap references non-existent config key: service-ca.crt
Aug 04 09:08:07.377496 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.377477    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 09:08:07.377496 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.377494    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f9bdbc4-m87rt: secret "image-registry-tls" not found
Aug 04 09:08:07.379570 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.379369    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:07.379570 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.379416    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 09:08:07.379570 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.379424    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls podName:d592a7b2-418a-412c-8632-e5c4fb4584e9 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:09.379408804 +0000 UTC m=+39.124815197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-jnr8f" (UID: "d592a7b2-418a-412c-8632-e5c4fb4584e9") : secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:07.379570 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.379498    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 09:08:07.379570 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.379510    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:09.379493329 +0000 UTC m=+39.124899718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : secret "router-metrics-certs-default" not found
Aug 04 09:08:07.379570 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.379533    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls podName:357194bb-769b-4cfa-ad63-a5a88e46d580 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:09.379522652 +0000 UTC m=+39.124929042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls") pod "dns-default-dl7rg" (UID: "357194bb-769b-4cfa-ad63-a5a88e46d580") : secret "dns-default-metrics-tls" not found
Aug 04 09:08:07.380012 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.379983    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls podName:c4391252-51fd-457a-9b90-f4cde5d9bd49 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:09.379966358 +0000 UTC m=+39.125372751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls") pod "image-registry-65f9bdbc4-m87rt" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49") : secret "image-registry-tls" not found
Aug 04 09:08:07.782901 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:07.782197    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:07.782901 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.782406    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 09:08:07.782901 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:07.782491    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert podName:b7fb4639-25ba-4de9-a479-50e30ff21bb5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:08.782472206 +0000 UTC m=+38.527878610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-56shw" (UID: "b7fb4639-25ba-4de9-a479-50e30ff21bb5") : secret "networking-console-plugin-cert" not found
Aug 04 09:08:08.004261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:08.004225    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:08.107218 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:08.107158    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:08.407643 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:08.407291    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:08.507558 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:08.507505    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:08.798879 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:08.798162    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:08.798879 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:08.798347    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 09:08:08.798879 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:08.798427    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert podName:b7fb4639-25ba-4de9-a479-50e30ff21bb5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:10.798407202 +0000 UTC m=+40.543813599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-56shw" (UID: "b7fb4639-25ba-4de9-a479-50e30ff21bb5") : secret "networking-console-plugin-cert" not found
Aug 04 09:08:09.404344 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:09.404298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:09.404808 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:09.404378    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:09.404808 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:09.404413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:09.404808 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:09.404516    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:09.404808 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:09.404572    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:09.404808 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:09.404599    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:09.404808 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.404801    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.404811    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:13.40478731 +0000 UTC m=+43.150193709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : configmap references non-existent config key: service-ca.crt
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.404861    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls podName:d592a7b2-418a-412c-8632-e5c4fb4584e9 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:13.404844346 +0000 UTC m=+43.150250738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-jnr8f" (UID: "d592a7b2-418a-412c-8632-e5c4fb4584e9") : secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.404929    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.404940    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f9bdbc4-m87rt: secret "image-registry-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.404985    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.405014    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.405039    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls podName:c4391252-51fd-457a-9b90-f4cde5d9bd49 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:13.404988979 +0000 UTC m=+43.150395410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls") pod "image-registry-65f9bdbc4-m87rt" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49") : secret "image-registry-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.405054    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.405058    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls podName:20990dc9-a395-49da-a3d7-b2a551bdf42a nodeName:}" failed. No retries permitted until 2026-08-04 09:08:13.40504707 +0000 UTC m=+43.150453485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-w77xt" (UID: "20990dc9-a395-49da-a3d7-b2a551bdf42a") : secret "samples-operator-tls" not found
Aug 04 09:08:09.405079 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.405076    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls podName:357194bb-769b-4cfa-ad63-a5a88e46d580 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:13.405066439 +0000 UTC m=+43.150472829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls") pod "dns-default-dl7rg" (UID: "357194bb-769b-4cfa-ad63-a5a88e46d580") : secret "dns-default-metrics-tls" not found
Aug 04 09:08:09.405438 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:09.405090    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:13.405082032 +0000 UTC m=+43.150488427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : secret "router-metrics-certs-default" not found
Aug 04 09:08:10.819395 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:10.818745    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:10.819395 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:10.819025    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 09:08:10.819395 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:10.819072    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert podName:b7fb4639-25ba-4de9-a479-50e30ff21bb5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:14.819059495 +0000 UTC m=+44.564465884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-56shw" (UID: "b7fb4639-25ba-4de9-a479-50e30ff21bb5") : secret "networking-console-plugin-cert" not found
Aug 04 09:08:11.167831 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:11.167799    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:11.268305 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:11.268257    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:11.598061 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:11.598024    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:11.660085 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:11.660031    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log" limit=1024
Aug 04 09:08:13.441412 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:13.441372    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:13.441438    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:13.441482    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:13.441544    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441559    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441559    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:13.441586    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441592    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f9bdbc4-m87rt: secret "image-registry-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441622    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls podName:357194bb-769b-4cfa-ad63-a5a88e46d580 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:21.441604038 +0000 UTC m=+51.187010451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls") pod "dns-default-dl7rg" (UID: "357194bb-769b-4cfa-ad63-a5a88e46d580") : secret "dns-default-metrics-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441638    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441673    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441647    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls podName:c4391252-51fd-457a-9b90-f4cde5d9bd49 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:21.441630043 +0000 UTC m=+51.187036436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls") pod "image-registry-65f9bdbc4-m87rt" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49") : secret "image-registry-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441571    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:13.441715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441732    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls podName:d592a7b2-418a-412c-8632-e5c4fb4584e9 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:21.441721173 +0000 UTC m=+51.187127562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-jnr8f" (UID: "d592a7b2-418a-412c-8632-e5c4fb4584e9") : secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441750    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:21.441741814 +0000 UTC m=+51.187148209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : secret "router-metrics-certs-default" not found
Aug 04 09:08:13.441896 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441765    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls podName:20990dc9-a395-49da-a3d7-b2a551bdf42a nodeName:}" failed. No retries permitted until 2026-08-04 09:08:21.441757721 +0000 UTC m=+51.187164116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-w77xt" (UID: "20990dc9-a395-49da-a3d7-b2a551bdf42a") : secret "samples-operator-tls" not found
Aug 04 09:08:13.442566 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:13.441842    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:21.441820628 +0000 UTC m=+51.187227036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : configmap references non-existent config key: service-ca.crt
Aug 04 09:08:14.854945 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:14.854909    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:14.855532 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:14.855034    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 09:08:14.855532 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:14.855109    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert podName:b7fb4639-25ba-4de9-a479-50e30ff21bb5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:22.855089673 +0000 UTC m=+52.600496065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-56shw" (UID: "b7fb4639-25ba-4de9-a479-50e30ff21bb5") : secret "networking-console-plugin-cert" not found
Aug 04 09:08:21.525836 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:21.525803    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:21.525860    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:21.525891    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:21.525941    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.525971    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:21.525981    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:21.526012    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.525986    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f9bdbc4-m87rt: secret "image-registry-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526076    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526021    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526121    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls podName:c4391252-51fd-457a-9b90-f4cde5d9bd49 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:37.526097421 +0000 UTC m=+67.271503812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls") pod "image-registry-65f9bdbc4-m87rt" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49") : secret "image-registry-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526140    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls podName:20990dc9-a395-49da-a3d7-b2a551bdf42a nodeName:}" failed. No retries permitted until 2026-08-04 09:08:37.526131121 +0000 UTC m=+67.271537510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-w77xt" (UID: "20990dc9-a395-49da-a3d7-b2a551bdf42a") : secret "samples-operator-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526021    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526035    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526157    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:37.526147644 +0000 UTC m=+67.271554116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : configmap references non-existent config key: service-ca.crt
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526219    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls podName:d592a7b2-418a-412c-8632-e5c4fb4584e9 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:37.526202142 +0000 UTC m=+67.271608530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-jnr8f" (UID: "d592a7b2-418a-412c-8632-e5c4fb4584e9") : secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:21.526230 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526232    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls podName:357194bb-769b-4cfa-ad63-a5a88e46d580 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:37.526225183 +0000 UTC m=+67.271631571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls") pod "dns-default-dl7rg" (UID: "357194bb-769b-4cfa-ad63-a5a88e46d580") : secret "dns-default-metrics-tls" not found
Aug 04 09:08:21.526780 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:21.526241    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:37.526236129 +0000 UTC m=+67.271642518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : secret "router-metrics-certs-default" not found
Aug 04 09:08:22.942509 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:22.942446    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:22.943028 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:22.942631    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 09:08:22.943028 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:22.942719    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert podName:b7fb4639-25ba-4de9-a479-50e30ff21bb5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:38.94269683 +0000 UTC m=+68.688103228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-56shw" (UID: "b7fb4639-25ba-4de9-a479-50e30ff21bb5") : secret "networking-console-plugin-cert" not found
Aug 04 09:08:23.014672 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.014206    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g" event={"ID":"0d44f5ad-d07b-485e-8422-e74daaf5324c","Type":"ContainerStarted","Data":"2c68d28866229f05ebc0a4c582b8fc17b85bfa94a4366f0ac87fd8b5456bf888"}
Aug 04 09:08:23.015978 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.015947    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h" event={"ID":"7af690d5-49cb-4bc8-b076-f0b5e4dda6ef","Type":"ContainerStarted","Data":"34fdae09e915afb278aa0863680f7a9569cfcdd4c7b87dca0c8bf9d4960841ce"}
Aug 04 09:08:23.018386 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.017917    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zn4vx" event={"ID":"399fb17d-fe90-4391-92ea-cb891aa88f9f","Type":"ContainerStarted","Data":"ef15da4ccf0aa95998ab527026480820f7645b5af76eb7acfaa3df7b019798b0"}
Aug 04 09:08:23.020107 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.020057    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5" event={"ID":"10fd3f18-b85e-4ffb-827a-f8e28dda9609","Type":"ContainerStarted","Data":"cba8ce9d1525fb0eb0d8ce057cada993f168cab42e4c9ef288375d9ee4ffc7e3"}
Aug 04 09:08:23.024191 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.024163    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3" containerID="6253ca7a2d2e79c09e7bd85c00e7d8adceeb8339893a2f2121339ee5894419ea" exitCode=0
Aug 04 09:08:23.024288 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.024261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerDied","Data":"6253ca7a2d2e79c09e7bd85c00e7d8adceeb8339893a2f2121339ee5894419ea"}
Aug 04 09:08:23.026052 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.026029    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" event={"ID":"65c21b83-7cb4-4954-ba10-aef3bb1abc89","Type":"ContainerStarted","Data":"9bf8430b03a4c576e65da75951ee51ebc5c5f8d0fc34535f76f31b5cbe1e38ad"}
Aug 04 09:08:23.030193 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.030139    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rzs4h" event={"ID":"96303cf3-7177-4101-98e9-7f7b7e13ad6f","Type":"ContainerStarted","Data":"2d7a17f185af96fe8dab65fa28a53be70ec32e8526506db360b7b9bf0352f4db"}
Aug 04 09:08:23.032611 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.032287    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/0.log"
Aug 04 09:08:23.032611 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.032322    2554 generic.go:356] "Generic (PLEG): container finished" podID="5737b403-f4dc-47d1-b71b-894f7a414920" containerID="785a0fd5ec7bfc4b6fa9ecaced6a849604b3a26bf8e6d3f4e7a78ea9b68e707a" exitCode=255
Aug 04 09:08:23.034690 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.032780    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" event={"ID":"5737b403-f4dc-47d1-b71b-894f7a414920","Type":"ContainerDied","Data":"785a0fd5ec7bfc4b6fa9ecaced6a849604b3a26bf8e6d3f4e7a78ea9b68e707a"}
Aug 04 09:08:23.034690 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.034235    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5nc8g" podStartSLOduration=5.340794481 podStartE2EDuration="21.034217641s" totalImagesPullingTime="15.69342316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:23.033292421 +0000 UTC m=+52.778698834" watchObservedRunningTime="2026-08-04 09:08:23.034217641 +0000 UTC m=+52.779624130"
Aug 04 09:08:23.034986 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.034957    2554 scope.go:117] "RemoveContainer" containerID="785a0fd5ec7bfc4b6fa9ecaced6a849604b3a26bf8e6d3f4e7a78ea9b68e707a"
Aug 04 09:08:23.036529 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.036485    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482" event={"ID":"62ae4795-910a-40bd-b809-3c03901ae840","Type":"ContainerStarted","Data":"24e9ff0855523212256679506c91b13457b982c86686a0e00c3bfa0a4a97bda9"}
Aug 04 09:08:23.038571 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.038546    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn" event={"ID":"b240883c-8d1a-4b5f-aa75-5d0d0e354e97","Type":"ContainerStarted","Data":"cd2c2c0a9b8e2d21bf21802b1e5f41bd6252ee8878ca519458afb6a443618dc9"}
Aug 04 09:08:23.054128 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.053562    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-jx72h" podStartSLOduration=5.34719861 podStartE2EDuration="21.053547211s" totalImagesPullingTime="15.706348601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:23.051610851 +0000 UTC m=+52.797017263" watchObservedRunningTime="2026-08-04 09:08:23.053547211 +0000 UTC m=+52.798953616"
Aug 04 09:08:23.055638 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.055369    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:23.057329 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.057288    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn"
Aug 04 09:08:23.074849 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.074793    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-rzs4h" podStartSLOduration=5.890216412 podStartE2EDuration="21.074776166s" totalImagesPullingTime="15.184559754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:23.073828498 +0000 UTC m=+52.819234909" watchObservedRunningTime="2026-08-04 09:08:23.074776166 +0000 UTC m=+52.820182578"
Aug 04 09:08:23.100147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.100091    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5" podStartSLOduration=4.417519207 podStartE2EDuration="20.100072059s" totalImagesPullingTime="15.682552852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:23.099261604 +0000 UTC m=+52.844668016" watchObservedRunningTime="2026-08-04 09:08:23.100072059 +0000 UTC m=+52.845478475"
Aug 04 09:08:23.123727 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.123674    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zn4vx" podStartSLOduration=2.4614138260000002 podStartE2EDuration="18.123653819s" totalImagesPullingTime="15.662239993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:23.122883993 +0000 UTC m=+52.868290405" watchObservedRunningTime="2026-08-04 09:08:23.123653819 +0000 UTC m=+52.869060224"
Aug 04 09:08:23.197473 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.197138    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffd8fc7df-qdxkn" podStartSLOduration=19.525117249 podStartE2EDuration="35.1969053s" totalImagesPullingTime="15.671788051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:23.19540151 +0000 UTC m=+52.940807922" watchObservedRunningTime="2026-08-04 09:08:23.1969053 +0000 UTC m=+52.942311712"
Aug 04 09:08:23.218525 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.218474    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482" podStartSLOduration=5.482953712 podStartE2EDuration="21.218434425s" totalImagesPullingTime="15.735480713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:23.217686568 +0000 UTC m=+52.963092981" watchObservedRunningTime="2026-08-04 09:08:23.218434425 +0000 UTC m=+52.963840837"
Aug 04 09:08:23.273586 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.273063    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dh7w2"]
Aug 04 09:08:23.304020 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.302879    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dh7w2"]
Aug 04 09:08:23.304020 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.303023    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.306470 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.305864    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 09:08:23.306470 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.306112    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56lhf\""
Aug 04 09:08:23.306470 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.306322    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 09:08:23.450524 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.450494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-data-volume\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.450640 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.450567    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.450640 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.450612    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssl4p\" (UniqueName: \"kubernetes.io/projected/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-api-access-ssl4p\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.450760 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.450641    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-crio-socket\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.450812 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.450759    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551229 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.551205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-data-volume\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551355 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.551263    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551355 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.551327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl4p\" (UniqueName: \"kubernetes.io/projected/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-api-access-ssl4p\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551478 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.551358    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-crio-socket\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551478 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:23.551444    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:23.551583 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:23.551531    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:24.051510871 +0000 UTC m=+53.796917274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:23.551583 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.551572    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551695 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.551573    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-data-volume\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551747 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.551690    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-crio-socket\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:23.551747 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:23.551715    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 09:08:23.551877 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:23.551767    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:24.051753166 +0000 UTC m=+53.797159582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : configmap "kube-rbac-proxy" not found
Aug 04 09:08:23.561863 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:23.561837    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssl4p\" (UniqueName: \"kubernetes.io/projected/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-api-access-ssl4p\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:24.045370 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.045332    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh" event={"ID":"7d682749-b1f3-48ea-8620-e9c71db5a38b","Type":"ContainerStarted","Data":"0833f7cfaa47b9f012ffd1d867d18fe26cd9a65744fcbdbdca6c00ce198e9bdc"}
Aug 04 09:08:24.049597 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.049177    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3" containerID="40a41de88782499667415199ba6ff2799b251393b29eabe685789f14b18836b6" exitCode=0
Aug 04 09:08:24.049597 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.049272    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerDied","Data":"40a41de88782499667415199ba6ff2799b251393b29eabe685789f14b18836b6"}
Aug 04 09:08:24.051736 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.051710    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" event={"ID":"65c21b83-7cb4-4954-ba10-aef3bb1abc89","Type":"ContainerStarted","Data":"48cc1e8bb4c31334e8f32bd4bf82f93aa05a9d65268f6640eb213229dcab0ee3"}
Aug 04 09:08:24.051861 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.051750    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" event={"ID":"65c21b83-7cb4-4954-ba10-aef3bb1abc89","Type":"ContainerStarted","Data":"4bf87e46b30c7762182e4a5b76294192be2ce96a89e3292e1357b26641210b63"}
Aug 04 09:08:24.053420 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.053399    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:08:24.053846 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.053831    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/0.log"
Aug 04 09:08:24.053927 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.053868    2554 generic.go:356] "Generic (PLEG): container finished" podID="5737b403-f4dc-47d1-b71b-894f7a414920" containerID="701fb788a5e802a7c04df372676bdd83bcdea5e6d820753c044b1e1d1ec51f28" exitCode=255
Aug 04 09:08:24.053978 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.053924    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" event={"ID":"5737b403-f4dc-47d1-b71b-894f7a414920","Type":"ContainerDied","Data":"701fb788a5e802a7c04df372676bdd83bcdea5e6d820753c044b1e1d1ec51f28"}
Aug 04 09:08:24.053978 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.053965    2554 scope.go:117] "RemoveContainer" containerID="785a0fd5ec7bfc4b6fa9ecaced6a849604b3a26bf8e6d3f4e7a78ea9b68e707a"
Aug 04 09:08:24.054160 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.054142    2554 scope.go:117] "RemoveContainer" containerID="701fb788a5e802a7c04df372676bdd83bcdea5e6d820753c044b1e1d1ec51f28"
Aug 04 09:08:24.054333 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:24.054312    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-p29gj_openshift-console-operator(5737b403-f4dc-47d1-b71b-894f7a414920)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" podUID="5737b403-f4dc-47d1-b71b-894f7a414920"
Aug 04 09:08:24.059254 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.059225    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:24.059353 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:24.059320    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 09:08:24.059353 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.059337    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:24.059491 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:24.059387    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:25.059367315 +0000 UTC m=+54.804773705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : configmap "kube-rbac-proxy" not found
Aug 04 09:08:24.059491 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:24.059438    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:24.059607 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:24.059512    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:25.05949414 +0000 UTC m=+54.804900566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:24.062983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.062947    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7994946696-9zjmh" podStartSLOduration=18.904307761 podStartE2EDuration="36.062932953s" totalImagesPullingTime="17.158625192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:24.062071483 +0000 UTC m=+53.807477887" watchObservedRunningTime="2026-08-04 09:08:24.062932953 +0000 UTC m=+53.808339367"
Aug 04 09:08:24.124511 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.124420    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" podStartSLOduration=20.399338953 podStartE2EDuration="36.124397432s" totalImagesPullingTime="15.725058479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:24.122979362 +0000 UTC m=+53.868385774" watchObservedRunningTime="2026-08-04 09:08:24.124397432 +0000 UTC m=+53.869803845"
Aug 04 09:08:24.491394 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.491357    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"]
Aug 04 09:08:24.498272 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.498247    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"
Aug 04 09:08:24.501407 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.500895    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 09:08:24.501407 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.501048    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 09:08:24.501407 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.501309    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8k5g2\""
Aug 04 09:08:24.505350 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.505320    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"]
Aug 04 09:08:24.515118 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.512650    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p98p4_fa959971-7124-4e82-ac32-243e2d21618b/dns-node-resolver/0.log"
Aug 04 09:08:24.565867 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.565828    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmf8l\" (UniqueName: \"kubernetes.io/projected/7593fd39-b53f-466d-ad27-f01841bb3b4f-kube-api-access-dmf8l\") pod \"migrator-68bc745d87-kb8zx\" (UID: \"7593fd39-b53f-466d-ad27-f01841bb3b4f\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"
Aug 04 09:08:24.667004 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.666969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmf8l\" (UniqueName: \"kubernetes.io/projected/7593fd39-b53f-466d-ad27-f01841bb3b4f-kube-api-access-dmf8l\") pod \"migrator-68bc745d87-kb8zx\" (UID: \"7593fd39-b53f-466d-ad27-f01841bb3b4f\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"
Aug 04 09:08:24.675688 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.675657    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmf8l\" (UniqueName: \"kubernetes.io/projected/7593fd39-b53f-466d-ad27-f01841bb3b4f-kube-api-access-dmf8l\") pod \"migrator-68bc745d87-kb8zx\" (UID: \"7593fd39-b53f-466d-ad27-f01841bb3b4f\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"
Aug 04 09:08:24.808910 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.808870    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"
Aug 04 09:08:24.946046 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:24.945865    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx"]
Aug 04 09:08:24.948801 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:24.948777    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7593fd39_b53f_466d_ad27_f01841bb3b4f.slice/crio-94795ed38e8f93d6c5fdbbdf1d0a51512cd8da03bd6a1e691709200c64b01005 WatchSource:0}: Error finding container 94795ed38e8f93d6c5fdbbdf1d0a51512cd8da03bd6a1e691709200c64b01005: Status 404 returned error can't find the container with id 94795ed38e8f93d6c5fdbbdf1d0a51512cd8da03bd6a1e691709200c64b01005
Aug 04 09:08:25.059584 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.059522    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:08:25.060003 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.059949    2554 scope.go:117] "RemoveContainer" containerID="701fb788a5e802a7c04df372676bdd83bcdea5e6d820753c044b1e1d1ec51f28"
Aug 04 09:08:25.060176 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:25.060151    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-p29gj_openshift-console-operator(5737b403-f4dc-47d1-b71b-894f7a414920)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" podUID="5737b403-f4dc-47d1-b71b-894f7a414920"
Aug 04 09:08:25.060849 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.060826    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx" event={"ID":"7593fd39-b53f-466d-ad27-f01841bb3b4f","Type":"ContainerStarted","Data":"94795ed38e8f93d6c5fdbbdf1d0a51512cd8da03bd6a1e691709200c64b01005"}
Aug 04 09:08:25.064353 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.064304    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d46d7" event={"ID":"3e469dfe-3fa7-4f8a-ad28-5fa847bee2f3","Type":"ContainerStarted","Data":"db013e1ac194bd405917ec241e84324248eabf2bb656a013bd34b94c455406ba"}
Aug 04 09:08:25.070992 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.070972    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:25.071082 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.071038    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:25.071129 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:25.071088    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 09:08:25.071161 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:25.071134    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:25.071161 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:25.071144    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:27.07112883 +0000 UTC m=+56.816535219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : configmap "kube-rbac-proxy" not found
Aug 04 09:08:25.071295 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:25.071169    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:27.071158698 +0000 UTC m=+56.816565087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:25.104514 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.104475    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d46d7" podStartSLOduration=8.829180481 podStartE2EDuration="54.10444734s" totalImagesPullingTime="45.275266859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:25.102144351 +0000 UTC m=+54.847550787" watchObservedRunningTime="2026-08-04 09:08:25.10444734 +0000 UTC m=+54.849853750"
Aug 04 09:08:25.708260 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.708232    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pn5ft_ade0fdde-53c5-4073-ad65-ae5ae3755bac/node-ca/0.log"
Aug 04 09:08:25.942332 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.942294    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:25.942530 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:25.942363    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:26.068631 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:26.068605    2554 scope.go:117] "RemoveContainer" containerID="701fb788a5e802a7c04df372676bdd83bcdea5e6d820753c044b1e1d1ec51f28"
Aug 04 09:08:26.069100 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:26.068764    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-p29gj_openshift-console-operator(5737b403-f4dc-47d1-b71b-894f7a414920)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" podUID="5737b403-f4dc-47d1-b71b-894f7a414920"
Aug 04 09:08:26.105570 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:26.105528    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zn4vx_399fb17d-fe90-4391-92ea-cb891aa88f9f/serve-healthcheck-canary/0.log"
Aug 04 09:08:27.073567 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:27.073534    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx" event={"ID":"7593fd39-b53f-466d-ad27-f01841bb3b4f","Type":"ContainerStarted","Data":"fbc1a007ba7a6e30457b4750853df16c7307283f6e74b835f2476306d4cbc41b"}
Aug 04 09:08:27.073979 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:27.073587    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx" event={"ID":"7593fd39-b53f-466d-ad27-f01841bb3b4f","Type":"ContainerStarted","Data":"97f5383cd39057ed2f9f957c60dcd27d4ad42da69aa35441d4481c342c28380a"}
Aug 04 09:08:27.089220 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:27.089186    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:27.089593 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:27.089326    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 09:08:27.089593 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:27.089401    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:31.089383248 +0000 UTC m=+60.834789642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : configmap "kube-rbac-proxy" not found
Aug 04 09:08:27.089593 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:27.089528    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:27.089786 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:27.089632    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:27.089786 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:27.089672    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:31.08966154 +0000 UTC m=+60.835067962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:27.090482 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:27.090422    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kb8zx" podStartSLOduration=1.708341054 podStartE2EDuration="3.090406589s" totalImagesPullingTime="1.382065535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:27.089070755 +0000 UTC m=+56.834477169" watchObservedRunningTime="2026-08-04 09:08:27.090406589 +0000 UTC m=+56.835813000"
Aug 04 09:08:31.125787 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:31.125751    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:31.126165 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:31.125909    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:31.126165 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:31.125953    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 09:08:31.126165 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:31.125907    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:31.126165 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:31.125971    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:39.125953451 +0000 UTC m=+68.871359842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:31.126165 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:31.126001    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:39.12599059 +0000 UTC m=+68.871396979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : configmap "kube-rbac-proxy" not found
Aug 04 09:08:32.936191 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:32.936164    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-snbxf"
Aug 04 09:08:35.467365 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.467335    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:35.467744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.467390    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:08:35.467744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.467480    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:35.470102 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.470069    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 09:08:35.470246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.470149    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd94k\" (UniqueName: \"kubernetes.io/projected/cccde668-6515-486f-a053-e9471621ea90-kube-api-access-nd94k\") pod \"network-check-target-gph88\" (UID: \"cccde668-6515-486f-a053-e9471621ea90\") " pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:35.470246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.470187    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 09:08:35.478385 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:35.478362    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 09:08:35.478517 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:35.478421    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs podName:808a8f84-514c-4f38-b761-2c3375d70ec0 nodeName:}" failed. No retries permitted until 2026-08-04 09:09:39.478401316 +0000 UTC m=+129.223807704 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs") pod "network-metrics-daemon-zft9s" (UID: "808a8f84-514c-4f38-b761-2c3375d70ec0") : secret "metrics-daemon-secret" not found
Aug 04 09:08:35.480439 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.480423    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcb9552-fcb4-4a61-8686-311e5c65e2a3-original-pull-secret\") pod \"global-pull-secret-syncer-5whhp\" (UID: \"cbcb9552-fcb4-4a61-8686-311e5c65e2a3\") " pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:35.590472 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.590425    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5whhp"
Aug 04 09:08:35.610435 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.610407    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jr9km\""
Aug 04 09:08:35.618668 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.618648    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:35.731041 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.730934    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5whhp"]
Aug 04 09:08:35.733541 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:35.733508    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcb9552_fcb4_4a61_8686_311e5c65e2a3.slice/crio-3ea7a7f689d828ec5cf07cf53788aba4da52b3eda42eecfd2e809d75de8c6835 WatchSource:0}: Error finding container 3ea7a7f689d828ec5cf07cf53788aba4da52b3eda42eecfd2e809d75de8c6835: Status 404 returned error can't find the container with id 3ea7a7f689d828ec5cf07cf53788aba4da52b3eda42eecfd2e809d75de8c6835
Aug 04 09:08:35.759019 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:35.758999    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gph88"]
Aug 04 09:08:35.761408 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:35.761382    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcccde668_6515_486f_a053_e9471621ea90.slice/crio-df4d09dba08c819b80201c06c499c5bdab1b19ad766fd95f6e54b56e10417298 WatchSource:0}: Error finding container df4d09dba08c819b80201c06c499c5bdab1b19ad766fd95f6e54b56e10417298: Status 404 returned error can't find the container with id df4d09dba08c819b80201c06c499c5bdab1b19ad766fd95f6e54b56e10417298
Aug 04 09:08:36.102499 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:36.102446    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5whhp" event={"ID":"cbcb9552-fcb4-4a61-8686-311e5c65e2a3","Type":"ContainerStarted","Data":"3ea7a7f689d828ec5cf07cf53788aba4da52b3eda42eecfd2e809d75de8c6835"}
Aug 04 09:08:36.103959 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:36.103932    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gph88" event={"ID":"cccde668-6515-486f-a053-e9471621ea90","Type":"ContainerStarted","Data":"7362e9060082fac949f45f4b2eeddef506d34c6a67829688c4abce6c8dac01cb"}
Aug 04 09:08:36.104076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:36.103978    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gph88" event={"ID":"cccde668-6515-486f-a053-e9471621ea90","Type":"ContainerStarted","Data":"df4d09dba08c819b80201c06c499c5bdab1b19ad766fd95f6e54b56e10417298"}
Aug 04 09:08:36.104076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:36.104007    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:08:36.125055 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:36.125004    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gph88" podStartSLOduration=65.124989089 podStartE2EDuration="1m5.124989089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:36.118899536 +0000 UTC m=+65.864305942" watchObservedRunningTime="2026-08-04 09:08:36.124989089 +0000 UTC m=+65.870395477"
Aug 04 09:08:37.588738 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.588705    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.588748    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.588769    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.588823    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.588850    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.588880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:37.588967    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:37.589025    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls podName:d592a7b2-418a-412c-8632-e5c4fb4584e9 nodeName:}" failed. No retries permitted until 2026-08-04 09:09:09.589006205 +0000 UTC m=+99.334412596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-jnr8f" (UID: "d592a7b2-418a-412c-8632-e5c4fb4584e9") : secret "cluster-monitoring-operator-tls" not found
Aug 04 09:08:37.589163 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:37.589042    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle podName:224cdd14-b33f-4cbb-a3e5-252e312cc879 nodeName:}" failed. No retries permitted until 2026-08-04 09:09:09.589033963 +0000 UTC m=+99.334440353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle") pod "router-default-d7f49d6c4-92bh4" (UID: "224cdd14-b33f-4cbb-a3e5-252e312cc879") : configmap references non-existent config key: service-ca.crt
Aug 04 09:08:37.591339 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.591311    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357194bb-769b-4cfa-ad63-a5a88e46d580-metrics-tls\") pod \"dns-default-dl7rg\" (UID: \"357194bb-769b-4cfa-ad63-a5a88e46d580\") " pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:37.591512 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.591488    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224cdd14-b33f-4cbb-a3e5-252e312cc879-metrics-certs\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:08:37.591780 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.591759    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/20990dc9-a395-49da-a3d7-b2a551bdf42a-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-w77xt\" (UID: \"20990dc9-a395-49da-a3d7-b2a551bdf42a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:37.591860 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.591785    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"image-registry-65f9bdbc4-m87rt\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") " pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:37.697836 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.697801    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-27s78\""
Aug 04 09:08:37.705398 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.705367    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:37.716369 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.716338    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7xnmk\""
Aug 04 09:08:37.724194 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.723972    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:37.745843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.745822    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xfgq4\""
Aug 04 09:08:37.754260 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.754149    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"
Aug 04 09:08:37.776661 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.776213    2554 scope.go:117] "RemoveContainer" containerID="701fb788a5e802a7c04df372676bdd83bcdea5e6d820753c044b1e1d1ec51f28"
Aug 04 09:08:37.891553 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.889563    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65f9bdbc4-m87rt"]
Aug 04 09:08:37.892522 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:37.892481    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4391252_51fd_457a_9b90_f4cde5d9bd49.slice/crio-5c84d59efd7e512b9d31c16080deddb93679b4c58bd3d21381883f4acce0aa40 WatchSource:0}: Error finding container 5c84d59efd7e512b9d31c16080deddb93679b4c58bd3d21381883f4acce0aa40: Status 404 returned error can't find the container with id 5c84d59efd7e512b9d31c16080deddb93679b4c58bd3d21381883f4acce0aa40
Aug 04 09:08:37.912548 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.912520    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dl7rg"]
Aug 04 09:08:37.917984 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:37.917953    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357194bb_769b_4cfa_ad63_a5a88e46d580.slice/crio-148e484684fca34ff1846f61928ee8ca05abd4a046859e8a95876294525c6e5e WatchSource:0}: Error finding container 148e484684fca34ff1846f61928ee8ca05abd4a046859e8a95876294525c6e5e: Status 404 returned error can't find the container with id 148e484684fca34ff1846f61928ee8ca05abd4a046859e8a95876294525c6e5e
Aug 04 09:08:37.939775 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:37.939620    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt"]
Aug 04 09:08:38.112561 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.112483    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt" event={"ID":"20990dc9-a395-49da-a3d7-b2a551bdf42a","Type":"ContainerStarted","Data":"97788925a2c7e68a4b46de1d4a72650e9b9babd8b122fb8d692d5856ea8d8a17"}
Aug 04 09:08:38.114104 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.114043    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dl7rg" event={"ID":"357194bb-769b-4cfa-ad63-a5a88e46d580","Type":"ContainerStarted","Data":"148e484684fca34ff1846f61928ee8ca05abd4a046859e8a95876294525c6e5e"}
Aug 04 09:08:38.115827 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.115782    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt" event={"ID":"c4391252-51fd-457a-9b90-f4cde5d9bd49","Type":"ContainerStarted","Data":"01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35"}
Aug 04 09:08:38.115827 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.115828    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt" event={"ID":"c4391252-51fd-457a-9b90-f4cde5d9bd49","Type":"ContainerStarted","Data":"5c84d59efd7e512b9d31c16080deddb93679b4c58bd3d21381883f4acce0aa40"}
Aug 04 09:08:38.116083 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.116063    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:38.118558 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.118535    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:08:38.118680 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.118583    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" event={"ID":"5737b403-f4dc-47d1-b71b-894f7a414920","Type":"ContainerStarted","Data":"b898b25fdd36b1e9bd6948869dcff78a99deb8841e02ea1aa4fa11000629f259"}
Aug 04 09:08:38.118871 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.118847    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:38.140833 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.140788    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt" podStartSLOduration=67.140769141 podStartE2EDuration="1m7.140769141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:38.138832707 +0000 UTC m=+67.884239128" watchObservedRunningTime="2026-08-04 09:08:38.140769141 +0000 UTC m=+67.886175553"
Aug 04 09:08:38.158760 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.157515    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj" podStartSLOduration=20.385069028 podStartE2EDuration="36.157496795s" totalImagesPullingTime="15.772427767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:38.157433139 +0000 UTC m=+67.902839576" watchObservedRunningTime="2026-08-04 09:08:38.157496795 +0000 UTC m=+67.902903206"
Aug 04 09:08:38.464833 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:38.464739    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-p29gj"
Aug 04 09:08:39.007711 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:39.007675    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:08:39.008169 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:39.007856    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 09:08:39.008169 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:39.007937    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert podName:b7fb4639-25ba-4de9-a479-50e30ff21bb5 nodeName:}" failed. No retries permitted until 2026-08-04 09:09:11.007915232 +0000 UTC m=+100.753321621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-56shw" (UID: "b7fb4639-25ba-4de9-a479-50e30ff21bb5") : secret "networking-console-plugin-cert" not found
Aug 04 09:08:39.209530 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:39.209501    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:39.209717 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:39.209609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:39.209717 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:39.209691    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:39.209838 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:08:39.209782    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls podName:e047cac7-feee-42b5-b9ff-94bdc83fd0b5 nodeName:}" failed. No retries permitted until 2026-08-04 09:08:55.209752492 +0000 UTC m=+84.955158912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dh7w2" (UID: "e047cac7-feee-42b5-b9ff-94bdc83fd0b5") : secret "insights-runtime-extractor-tls" not found
Aug 04 09:08:39.210163 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:39.210135    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:42.140691 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:42.140646    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dl7rg" event={"ID":"357194bb-769b-4cfa-ad63-a5a88e46d580","Type":"ContainerStarted","Data":"f74d9d3841946b71593094a3c2a48e108aa92f021bf94ade31c67c9d248713ea"}
Aug 04 09:08:42.141148 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:42.140721    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dl7rg" event={"ID":"357194bb-769b-4cfa-ad63-a5a88e46d580","Type":"ContainerStarted","Data":"6ccf6d059dff10f4acec9bf6b2f048963bce1ff4c9923dbc5cc01fc683f52809"}
Aug 04 09:08:42.141148 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:42.140758    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:42.142164 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:42.142133    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5whhp" event={"ID":"cbcb9552-fcb4-4a61-8686-311e5c65e2a3","Type":"ContainerStarted","Data":"2665dc977889fad5e3b81c6f850c57cd3d7f8ca7e4bc6d2f5e825654be17e8d5"}
Aug 04 09:08:42.157930 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:42.157886    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dl7rg" podStartSLOduration=33.77864219 podStartE2EDuration="37.157871186s" totalImagesPullingTime="3.379228996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:42.157004756 +0000 UTC m=+71.902411192" watchObservedRunningTime="2026-08-04 09:08:42.157871186 +0000 UTC m=+71.903277622"
Aug 04 09:08:42.176496 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:42.176423    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5whhp" podStartSLOduration=65.605582238 podStartE2EDuration="1m11.176404274s" totalImagesPullingTime="5.570822036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:42.174869884 +0000 UTC m=+71.920276294" watchObservedRunningTime="2026-08-04 09:08:42.176404274 +0000 UTC m=+71.921810684"
Aug 04 09:08:43.147654 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:43.147623    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt" event={"ID":"20990dc9-a395-49da-a3d7-b2a551bdf42a","Type":"ContainerStarted","Data":"3002d039abef6605137c2b0c0b9c3319c55ad016f68ff59a9417d81e15b5ba41"}
Aug 04 09:08:44.153166 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:44.153123    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt" event={"ID":"20990dc9-a395-49da-a3d7-b2a551bdf42a","Type":"ContainerStarted","Data":"1279487cd265eade0fbd73ce1a65fb54d3d3d750dc95bffc9449ef5b72836607"}
Aug 04 09:08:44.173471 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:44.173409    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-w77xt" podStartSLOduration=37.123894137 podStartE2EDuration="42.173394625s" totalImagesPullingTime="5.049500488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:44.17188322 +0000 UTC m=+73.917289632" watchObservedRunningTime="2026-08-04 09:08:44.173394625 +0000 UTC m=+73.918801036"
Aug 04 09:08:52.150715 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:52.150587    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dl7rg"
Aug 04 09:08:55.246139 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:55.246101    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:55.248633 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:55.248607    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e047cac7-feee-42b5-b9ff-94bdc83fd0b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh7w2\" (UID: \"e047cac7-feee-42b5-b9ff-94bdc83fd0b5\") " pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:55.491474 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:55.491422    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56lhf\""
Aug 04 09:08:55.499727 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:55.499669    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dh7w2"
Aug 04 09:08:55.666487 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:55.666441    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dh7w2"]
Aug 04 09:08:55.668214 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:08:55.668189    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode047cac7_feee_42b5_b9ff_94bdc83fd0b5.slice/crio-4fb0ce3fbe7d0b04b7cb40d30782c7a057e906f45d19984a9a10a470517af97e WatchSource:0}: Error finding container 4fb0ce3fbe7d0b04b7cb40d30782c7a057e906f45d19984a9a10a470517af97e: Status 404 returned error can't find the container with id 4fb0ce3fbe7d0b04b7cb40d30782c7a057e906f45d19984a9a10a470517af97e
Aug 04 09:08:56.197473 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:56.197432    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh7w2" event={"ID":"e047cac7-feee-42b5-b9ff-94bdc83fd0b5","Type":"ContainerStarted","Data":"b865adc5dd1f195ba4e68f71164fba72eadec97f37cdf27842a5d5cf2700bbf1"}
Aug 04 09:08:56.197641 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:56.197512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh7w2" event={"ID":"e047cac7-feee-42b5-b9ff-94bdc83fd0b5","Type":"ContainerStarted","Data":"4fb0ce3fbe7d0b04b7cb40d30782c7a057e906f45d19984a9a10a470517af97e"}
Aug 04 09:08:57.202816 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:57.202722    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh7w2" event={"ID":"e047cac7-feee-42b5-b9ff-94bdc83fd0b5","Type":"ContainerStarted","Data":"35b48c064ba0e5d4526afc747b20dd6eb9d682199778b654dc759583f10b5ea3"}
Aug 04 09:08:57.711371 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:57.711334    2554 patch_prober.go:28] interesting pod/image-registry-65f9bdbc4-m87rt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 09:08:57.711592 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:57.711390    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt" podUID="c4391252-51fd-457a-9b90-f4cde5d9bd49" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 09:08:59.129033 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:59.129011    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:08:59.212012 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:59.211982    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh7w2" event={"ID":"e047cac7-feee-42b5-b9ff-94bdc83fd0b5","Type":"ContainerStarted","Data":"0f1e1d9d230ac2dd8ca6e9288c5095b3bce86847ea536b8efe4e1c0f13436b93"}
Aug 04 09:08:59.230705 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:08:59.230661    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dh7w2" podStartSLOduration=33.509289855 podStartE2EDuration="36.230644976s" totalImagesPullingTime="2.721355121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:08:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:08:59.229812434 +0000 UTC m=+88.975218846" watchObservedRunningTime="2026-08-04 09:08:59.230644976 +0000 UTC m=+88.976051389"
Aug 04 09:09:07.110497 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:07.110467    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gph88"
Aug 04 09:09:09.645352 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.645316    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65f9bdbc4-m87rt"]
Aug 04 09:09:09.670695 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.670664    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:09:09.670935 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.670795    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:09:09.671655 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.671627    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/224cdd14-b33f-4cbb-a3e5-252e312cc879-service-ca-bundle\") pod \"router-default-d7f49d6c4-92bh4\" (UID: \"224cdd14-b33f-4cbb-a3e5-252e312cc879\") " pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:09:09.673558 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.673535    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d592a7b2-418a-412c-8632-e5c4fb4584e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-jnr8f\" (UID: \"d592a7b2-418a-412c-8632-e5c4fb4584e9\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:09:09.863833 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.863800    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-plzkf\""
Aug 04 09:09:09.872180 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.872150    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:09:09.885996 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.885976    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2tpjn\""
Aug 04 09:09:09.894326 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:09.894306    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"
Aug 04 09:09:10.040745 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.040714    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d7f49d6c4-92bh4"]
Aug 04 09:09:10.046069 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:09:10.043399    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224cdd14_b33f_4cbb_a3e5_252e312cc879.slice/crio-bb7c89fc2aa5ad0f453f973521191c047e380dc6df31b63488280ae19e08e7ae WatchSource:0}: Error finding container bb7c89fc2aa5ad0f453f973521191c047e380dc6df31b63488280ae19e08e7ae: Status 404 returned error can't find the container with id bb7c89fc2aa5ad0f453f973521191c047e380dc6df31b63488280ae19e08e7ae
Aug 04 09:09:10.046069 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.043724    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f"]
Aug 04 09:09:10.048664 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:09:10.048633    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd592a7b2_418a_412c_8632_e5c4fb4584e9.slice/crio-fad4071ee62650d41dba1a1a5f115c110cffc37c7a1b552253333abdbe42af93 WatchSource:0}: Error finding container fad4071ee62650d41dba1a1a5f115c110cffc37c7a1b552253333abdbe42af93: Status 404 returned error can't find the container with id fad4071ee62650d41dba1a1a5f115c110cffc37c7a1b552253333abdbe42af93
Aug 04 09:09:10.250967 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.250876    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d7f49d6c4-92bh4" event={"ID":"224cdd14-b33f-4cbb-a3e5-252e312cc879","Type":"ContainerStarted","Data":"ed21317aa2b57a256a8769ec6be25bc8ea270d4a7db54923b4572d7b9b177664"}
Aug 04 09:09:10.250967 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.250945    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d7f49d6c4-92bh4" event={"ID":"224cdd14-b33f-4cbb-a3e5-252e312cc879","Type":"ContainerStarted","Data":"bb7c89fc2aa5ad0f453f973521191c047e380dc6df31b63488280ae19e08e7ae"}
Aug 04 09:09:10.252062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.252034    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f" event={"ID":"d592a7b2-418a-412c-8632-e5c4fb4584e9","Type":"ContainerStarted","Data":"fad4071ee62650d41dba1a1a5f115c110cffc37c7a1b552253333abdbe42af93"}
Aug 04 09:09:10.872481 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.872419    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:09:10.875220 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.875198    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:09:10.897604 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:10.897561    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-d7f49d6c4-92bh4" podStartSLOduration=68.897546758 podStartE2EDuration="1m8.897546758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:09:10.278818912 +0000 UTC m=+100.024225324" watchObservedRunningTime="2026-08-04 09:09:10.897546758 +0000 UTC m=+100.642953169"
Aug 04 09:09:11.084743 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:11.084706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:09:11.087560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:11.087536    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b7fb4639-25ba-4de9-a479-50e30ff21bb5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-56shw\" (UID: \"b7fb4639-25ba-4de9-a479-50e30ff21bb5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:09:11.211232 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:11.211196    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qmmsr\""
Aug 04 09:09:11.219527 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:11.219502    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw"
Aug 04 09:09:11.255372 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:11.255339    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:09:11.256660 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:11.256639    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-d7f49d6c4-92bh4"
Aug 04 09:09:11.374074 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:11.374042    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-56shw"]
Aug 04 09:09:11.846024 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:09:11.845982    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fb4639_25ba_4de9_a479_50e30ff21bb5.slice/crio-bf19cf230106ee6d9aba5a90485119b42c51a3f21d6f665f37b2cd81c6aeb98d WatchSource:0}: Error finding container bf19cf230106ee6d9aba5a90485119b42c51a3f21d6f665f37b2cd81c6aeb98d: Status 404 returned error can't find the container with id bf19cf230106ee6d9aba5a90485119b42c51a3f21d6f665f37b2cd81c6aeb98d
Aug 04 09:09:12.261081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:12.260990    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f" event={"ID":"d592a7b2-418a-412c-8632-e5c4fb4584e9","Type":"ContainerStarted","Data":"758f42b1181bc05e342d9d428ba9fdeaf5eb08183d825b87a5a3c8e606930e5b"}
Aug 04 09:09:12.262225 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:12.262196    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw" event={"ID":"b7fb4639-25ba-4de9-a479-50e30ff21bb5","Type":"ContainerStarted","Data":"bf19cf230106ee6d9aba5a90485119b42c51a3f21d6f665f37b2cd81c6aeb98d"}
Aug 04 09:09:12.342068 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:12.342011    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f" podStartSLOduration=67.521208186 podStartE2EDuration="1m9.341989091s" totalImagesPullingTime="1.820780905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:09:12.324748335 +0000 UTC m=+102.070154746" watchObservedRunningTime="2026-08-04 09:09:12.341989091 +0000 UTC m=+102.087395515"
Aug 04 09:09:14.272896 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:14.272855    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw" event={"ID":"b7fb4639-25ba-4de9-a479-50e30ff21bb5","Type":"ContainerStarted","Data":"9014d34b03c8e508248602b8a12dbc49d16fd219042d820a4a8ff2219c9dcd50"}
Aug 04 09:09:14.294325 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:14.293246    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-56shw" podStartSLOduration=66.668317914 podStartE2EDuration="1m8.293224925s" totalImagesPullingTime="1.624907011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:09:14.290192785 +0000 UTC m=+104.035599209" watchObservedRunningTime="2026-08-04 09:09:14.293224925 +0000 UTC m=+104.038631338"
Aug 04 09:09:23.310967 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:23.310935    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:09:23.311359 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:23.310977    2554 generic.go:356] "Generic (PLEG): container finished" podID="d592a7b2-418a-412c-8632-e5c4fb4584e9" containerID="758f42b1181bc05e342d9d428ba9fdeaf5eb08183d825b87a5a3c8e606930e5b" exitCode=2
Aug 04 09:09:23.311359 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:23.311058    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f" event={"ID":"d592a7b2-418a-412c-8632-e5c4fb4584e9","Type":"ContainerDied","Data":"758f42b1181bc05e342d9d428ba9fdeaf5eb08183d825b87a5a3c8e606930e5b"}
Aug 04 09:09:23.311434 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:23.311360    2554 scope.go:117] "RemoveContainer" containerID="758f42b1181bc05e342d9d428ba9fdeaf5eb08183d825b87a5a3c8e606930e5b"
Aug 04 09:09:24.316862 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:24.316834    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:09:24.317230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:24.316936    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-jnr8f" event={"ID":"d592a7b2-418a-412c-8632-e5c4fb4584e9","Type":"ContainerStarted","Data":"053952d1a7755ba07bfcf66e20b9b29a2f52f03f88f1d33711c3f88a2310824b"}
Aug 04 09:09:27.073706 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.073667    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rwzfn"]
Aug 04 09:09:27.076369 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.076351    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.079192 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.079172    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 09:09:27.079344 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.079327    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 09:09:27.079404 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.079348    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 09:09:27.079502 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.079482    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lhsjg\""
Aug 04 09:09:27.080236 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.080224    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 09:09:27.221648 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221619    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-tls\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.221822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221675    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjsf\" (UniqueName: \"kubernetes.io/projected/1a03503f-866a-45fd-ab65-591c492bfbc2-kube-api-access-5pjsf\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.221822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221698    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.221822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221721    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-textfile\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.221822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-sys\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.221822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221757    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.221822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221774    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a03503f-866a-45fd-ab65-591c492bfbc2-metrics-client-ca\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.222014 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221865    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-root\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.222014 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.221901    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-wtmp\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.322843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.322796    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-root\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.322843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.322840    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-wtmp\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.322923    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-root\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.322966    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-tls\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.322992    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-wtmp\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323055    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjsf\" (UniqueName: \"kubernetes.io/projected/1a03503f-866a-45fd-ab65-591c492bfbc2-kube-api-access-5pjsf\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323238 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323238 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323118    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-textfile\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323238 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:09:27.323081    2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 09:09:27.323238 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-sys\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323238 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323178    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323238 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323218    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a03503f-866a-45fd-ab65-591c492bfbc2-metrics-client-ca\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323534 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323225    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a03503f-866a-45fd-ab65-591c492bfbc2-sys\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323534 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:09:27.323248    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-tls podName:1a03503f-866a-45fd-ab65-591c492bfbc2 nodeName:}" failed. No retries permitted until 2026-08-04 09:09:27.823222352 +0000 UTC m=+117.568628758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-tls") pod "node-exporter-rwzfn" (UID: "1a03503f-866a-45fd-ab65-591c492bfbc2") : secret "node-exporter-tls" not found
Aug 04 09:09:27.323634 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323616    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-textfile\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323795    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.323850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.323796    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a03503f-866a-45fd-ab65-591c492bfbc2-metrics-client-ca\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.325750 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.325728    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.336857 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.336829    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjsf\" (UniqueName: \"kubernetes.io/projected/1a03503f-866a-45fd-ab65-591c492bfbc2-kube-api-access-5pjsf\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.829385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.829352    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-tls\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.831751 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.831725    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a03503f-866a-45fd-ab65-591c492bfbc2-node-exporter-tls\") pod \"node-exporter-rwzfn\" (UID: \"1a03503f-866a-45fd-ab65-591c492bfbc2\") " pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.986331 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:27.986302    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwzfn"
Aug 04 09:09:27.996534 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:09:27.996506    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a03503f_866a_45fd_ab65_591c492bfbc2.slice/crio-2f10e2e539085c624dbe1b92a065eeb717a5e1a4689aaf55615d0303b8d88f63 WatchSource:0}: Error finding container 2f10e2e539085c624dbe1b92a065eeb717a5e1a4689aaf55615d0303b8d88f63: Status 404 returned error can't find the container with id 2f10e2e539085c624dbe1b92a065eeb717a5e1a4689aaf55615d0303b8d88f63
Aug 04 09:09:28.332729 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:28.332695    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwzfn" event={"ID":"1a03503f-866a-45fd-ab65-591c492bfbc2","Type":"ContainerStarted","Data":"2f10e2e539085c624dbe1b92a065eeb717a5e1a4689aaf55615d0303b8d88f63"}
Aug 04 09:09:29.337553 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:29.337524    2554 generic.go:356] "Generic (PLEG): container finished" podID="1a03503f-866a-45fd-ab65-591c492bfbc2" containerID="8f4202d0e5604556b47f1468886adeae2207d9381033058490e21fa8883e2677" exitCode=0
Aug 04 09:09:29.337878 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:29.337569    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwzfn" event={"ID":"1a03503f-866a-45fd-ab65-591c492bfbc2","Type":"ContainerDied","Data":"8f4202d0e5604556b47f1468886adeae2207d9381033058490e21fa8883e2677"}
Aug 04 09:09:30.342926 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:30.342889    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwzfn" event={"ID":"1a03503f-866a-45fd-ab65-591c492bfbc2","Type":"ContainerStarted","Data":"1f92a9b871293116f97af3cb007c2bbd3e6375344ad4f4864f08497fbd5827fd"}
Aug 04 09:09:30.343277 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:30.342948    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwzfn" event={"ID":"1a03503f-866a-45fd-ab65-591c492bfbc2","Type":"ContainerStarted","Data":"1d2a66d82019285109758990ed1ab1a5620236c2bc995c2a4a60b9e86b2c2ef5"}
Aug 04 09:09:30.365545 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:30.365503    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rwzfn" podStartSLOduration=2.196234516 podStartE2EDuration="3.365488144s" totalImagesPullingTime="1.097422364s" totalInitContainerRuntime="71.831264ms" isStatefulPod=true podCreationTimestamp="2026-08-04 09:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:09:30.364211171 +0000 UTC m=+120.109617592" watchObservedRunningTime="2026-08-04 09:09:30.365488144 +0000 UTC m=+120.110894552"
Aug 04 09:09:34.665067 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.665008    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt" podUID="c4391252-51fd-457a-9b90-f4cde5d9bd49" containerName="registry" containerID="cri-o://01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35" gracePeriod=30
Aug 04 09:09:34.902807 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.902780    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:09:34.983201 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983133    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-certificates\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983201 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983166    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhklm\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-kube-api-access-zhklm\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983201 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983191    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-installation-pull-secrets\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983231    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983263    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-bound-sa-token\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983291    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-image-registry-private-configuration\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983330    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-trusted-ca\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983391    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4391252-51fd-457a-9b90-f4cde5d9bd49-ca-trust-extracted\") pod \"c4391252-51fd-457a-9b90-f4cde5d9bd49\" (UID: \"c4391252-51fd-457a-9b90-f4cde5d9bd49\") "
Aug 04 09:09:34.983687 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983625    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:09:34.983964 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.983824    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:09:34.984205 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.984153    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-trusted-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:34.984205 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.984180    2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-certificates\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:34.985833 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.985805    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-kube-api-access-zhklm" (OuterVolumeSpecName: "kube-api-access-zhklm") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "kube-api-access-zhklm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:09:34.985916 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.985827    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:09:34.986200 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.986173    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:09:34.986381 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.986356    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:09:34.986476 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.986414    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:09:34.992203 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:34.992176    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4391252-51fd-457a-9b90-f4cde5d9bd49-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c4391252-51fd-457a-9b90-f4cde5d9bd49" (UID: "c4391252-51fd-457a-9b90-f4cde5d9bd49"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:09:35.084810 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.084782    2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4391252-51fd-457a-9b90-f4cde5d9bd49-ca-trust-extracted\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:35.084810 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.084806    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhklm\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-kube-api-access-zhklm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:35.084945 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.084815    2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-installation-pull-secrets\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:35.084945 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.084823    2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-registry-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:35.084945 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.084833    2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4391252-51fd-457a-9b90-f4cde5d9bd49-bound-sa-token\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:35.084945 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.084841    2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4391252-51fd-457a-9b90-f4cde5d9bd49-image-registry-private-configuration\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:09:35.362127 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.362090    2554 generic.go:356] "Generic (PLEG): container finished" podID="c4391252-51fd-457a-9b90-f4cde5d9bd49" containerID="01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35" exitCode=0
Aug 04 09:09:35.362248 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.362133    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt"
Aug 04 09:09:35.362248 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.362181    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt" event={"ID":"c4391252-51fd-457a-9b90-f4cde5d9bd49","Type":"ContainerDied","Data":"01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35"}
Aug 04 09:09:35.362248 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.362235    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f9bdbc4-m87rt" event={"ID":"c4391252-51fd-457a-9b90-f4cde5d9bd49","Type":"ContainerDied","Data":"5c84d59efd7e512b9d31c16080deddb93679b4c58bd3d21381883f4acce0aa40"}
Aug 04 09:09:35.362356 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.362259    2554 scope.go:117] "RemoveContainer" containerID="01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35"
Aug 04 09:09:35.370763 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.370748    2554 scope.go:117] "RemoveContainer" containerID="01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35"
Aug 04 09:09:35.371029 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:09:35.371009    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35\": container with ID starting with 01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35 not found: ID does not exist" containerID="01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35"
Aug 04 09:09:35.371079 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.371037    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35"} err="failed to get container status \"01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35\": rpc error: code = NotFound desc = could not find container \"01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35\": container with ID starting with 01651691220b574c8d2b217c78df0b86885d1c2a8550302f6e1f3aeec71abd35 not found: ID does not exist"
Aug 04 09:09:35.383964 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.383942    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65f9bdbc4-m87rt"]
Aug 04 09:09:35.388137 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:35.388117    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65f9bdbc4-m87rt"]
Aug 04 09:09:36.780910 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:36.780875    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4391252-51fd-457a-9b90-f4cde5d9bd49" path="/var/lib/kubelet/pods/c4391252-51fd-457a-9b90-f4cde5d9bd49/volumes"
Aug 04 09:09:38.376079 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:38.376045    2554 generic.go:356] "Generic (PLEG): container finished" podID="96303cf3-7177-4101-98e9-7f7b7e13ad6f" containerID="2d7a17f185af96fe8dab65fa28a53be70ec32e8526506db360b7b9bf0352f4db" exitCode=0
Aug 04 09:09:38.376440 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:38.376122    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rzs4h" event={"ID":"96303cf3-7177-4101-98e9-7f7b7e13ad6f","Type":"ContainerDied","Data":"2d7a17f185af96fe8dab65fa28a53be70ec32e8526506db360b7b9bf0352f4db"}
Aug 04 09:09:38.376522 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:38.376489    2554 scope.go:117] "RemoveContainer" containerID="2d7a17f185af96fe8dab65fa28a53be70ec32e8526506db360b7b9bf0352f4db"
Aug 04 09:09:39.185861 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.185825    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7f49d6c4-92bh4_224cdd14-b33f-4cbb-a3e5-252e312cc879/router/0.log"
Aug 04 09:09:39.204704 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.204682    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zn4vx_399fb17d-fe90-4391-92ea-cb891aa88f9f/serve-healthcheck-canary/0.log"
Aug 04 09:09:39.381954 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.381920    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rzs4h" event={"ID":"96303cf3-7177-4101-98e9-7f7b7e13ad6f","Type":"ContainerStarted","Data":"3e2175dda79634792f0614a49d1afd1dfbeeacafd96353eab001171e71a861ac"}
Aug 04 09:09:39.383295 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.383268    2554 generic.go:356] "Generic (PLEG): container finished" podID="62ae4795-910a-40bd-b809-3c03901ae840" containerID="24e9ff0855523212256679506c91b13457b982c86686a0e00c3bfa0a4a97bda9" exitCode=0
Aug 04 09:09:39.383403 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.383325    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482" event={"ID":"62ae4795-910a-40bd-b809-3c03901ae840","Type":"ContainerDied","Data":"24e9ff0855523212256679506c91b13457b982c86686a0e00c3bfa0a4a97bda9"}
Aug 04 09:09:39.383618 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.383604    2554 scope.go:117] "RemoveContainer" containerID="24e9ff0855523212256679506c91b13457b982c86686a0e00c3bfa0a4a97bda9"
Aug 04 09:09:39.519519 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.519486    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:09:39.521934 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.521913    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808a8f84-514c-4f38-b761-2c3375d70ec0-metrics-certs\") pod \"network-metrics-daemon-zft9s\" (UID: \"808a8f84-514c-4f38-b761-2c3375d70ec0\") " pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:09:39.802411 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.802333    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djwk2\""
Aug 04 09:09:39.810501 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.810483    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zft9s"
Aug 04 09:09:39.948174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:39.948147    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zft9s"]
Aug 04 09:09:39.949480 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:09:39.949425    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808a8f84_514c_4f38_b761_2c3375d70ec0.slice/crio-c11f01a64efc74838fb28d31ae7866dd0ad777d5ce9c484195f44133a223a73a WatchSource:0}: Error finding container c11f01a64efc74838fb28d31ae7866dd0ad777d5ce9c484195f44133a223a73a: Status 404 returned error can't find the container with id c11f01a64efc74838fb28d31ae7866dd0ad777d5ce9c484195f44133a223a73a
Aug 04 09:09:40.387755 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:40.387720    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zft9s" event={"ID":"808a8f84-514c-4f38-b761-2c3375d70ec0","Type":"ContainerStarted","Data":"c11f01a64efc74838fb28d31ae7866dd0ad777d5ce9c484195f44133a223a73a"}
Aug 04 09:09:40.389388 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:40.389364    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-bx482" event={"ID":"62ae4795-910a-40bd-b809-3c03901ae840","Type":"ContainerStarted","Data":"b2dae44337adeb840f838d4e9a252aab31e420b5979363edf647f682a6602f6f"}
Aug 04 09:09:41.394716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:41.394679    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zft9s" event={"ID":"808a8f84-514c-4f38-b761-2c3375d70ec0","Type":"ContainerStarted","Data":"3c90cfb7da045f114fc85a76434d238abd51baf2269fd70bad5fe4967fc7454f"}
Aug 04 09:09:42.400096 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:42.400059    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zft9s" event={"ID":"808a8f84-514c-4f38-b761-2c3375d70ec0","Type":"ContainerStarted","Data":"6e22e969b6b0a3b3609366f73a0f17504327a6cdf55fe5b9780c08b02d0a41a6"}
Aug 04 09:09:42.422382 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:42.422330    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zft9s" podStartSLOduration=130.123333427 podStartE2EDuration="2m11.422315303s" totalImagesPullingTime="1.298981876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:09:42.420230985 +0000 UTC m=+132.165637421" watchObservedRunningTime="2026-08-04 09:09:42.422315303 +0000 UTC m=+132.167721713"
Aug 04 09:09:44.410026 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:44.409992    2554 generic.go:356] "Generic (PLEG): container finished" podID="10fd3f18-b85e-4ffb-827a-f8e28dda9609" containerID="cba8ce9d1525fb0eb0d8ce057cada993f168cab42e4c9ef288375d9ee4ffc7e3" exitCode=0
Aug 04 09:09:44.410395 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:44.410074    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5" event={"ID":"10fd3f18-b85e-4ffb-827a-f8e28dda9609","Type":"ContainerDied","Data":"cba8ce9d1525fb0eb0d8ce057cada993f168cab42e4c9ef288375d9ee4ffc7e3"}
Aug 04 09:09:44.410438 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:44.410401    2554 scope.go:117] "RemoveContainer" containerID="cba8ce9d1525fb0eb0d8ce057cada993f168cab42e4c9ef288375d9ee4ffc7e3"
Aug 04 09:09:45.415924 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:45.415885    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-j4ws5" event={"ID":"10fd3f18-b85e-4ffb-827a-f8e28dda9609","Type":"ContainerStarted","Data":"ec7c2573d9e2ef2245eaef00177b7a530b008afc1893b21c1cd5b6755d5bd2f3"}
Aug 04 09:09:46.008695 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:46.008661    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" podUID="65c21b83-7cb4-4954-ba10-aef3bb1abc89" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 09:09:56.008828 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:09:56.008790    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" podUID="65c21b83-7cb4-4954-ba10-aef3bb1abc89" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 09:10:06.007768 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:10:06.007728    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" podUID="65c21b83-7cb4-4954-ba10-aef3bb1abc89" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 09:10:06.008209 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:10:06.007810    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l"
Aug 04 09:10:06.008445 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:10:06.008424    2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"48cc1e8bb4c31334e8f32bd4bf82f93aa05a9d65268f6640eb213229dcab0ee3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Aug 04 09:10:06.008545 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:10:06.008503    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" podUID="65c21b83-7cb4-4954-ba10-aef3bb1abc89" containerName="service-proxy" containerID="cri-o://48cc1e8bb4c31334e8f32bd4bf82f93aa05a9d65268f6640eb213229dcab0ee3" gracePeriod=30
Aug 04 09:10:06.499801 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:10:06.499763    2554 generic.go:356] "Generic (PLEG): container finished" podID="65c21b83-7cb4-4954-ba10-aef3bb1abc89" containerID="48cc1e8bb4c31334e8f32bd4bf82f93aa05a9d65268f6640eb213229dcab0ee3" exitCode=2
Aug 04 09:10:06.499961 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:10:06.499834    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" event={"ID":"65c21b83-7cb4-4954-ba10-aef3bb1abc89","Type":"ContainerDied","Data":"48cc1e8bb4c31334e8f32bd4bf82f93aa05a9d65268f6640eb213229dcab0ee3"}
Aug 04 09:10:06.499961 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:10:06.499876    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757d79f49b-gxp7l" event={"ID":"65c21b83-7cb4-4954-ba10-aef3bb1abc89","Type":"ContainerStarted","Data":"005bc6fe36543313b3387e6a8949fa282ed242adb50ebcb22be257a0abe285f6"}
Aug 04 09:12:30.663965 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:12:30.663934    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:12:30.670007 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:12:30.669979    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:12:30.671272 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:12:30.671253    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:12:30.677346 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:12:30.677328    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:12:30.683697 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:12:30.683668    2554 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 09:13:21.711670 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.711592    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"]
Aug 04 09:13:21.712079 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.711880    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4391252-51fd-457a-9b90-f4cde5d9bd49" containerName="registry"
Aug 04 09:13:21.712079 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.711889    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4391252-51fd-457a-9b90-f4cde5d9bd49" containerName="registry"
Aug 04 09:13:21.712079 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.711939    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4391252-51fd-457a-9b90-f4cde5d9bd49" containerName="registry"
Aug 04 09:13:21.714507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.714490    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.718008 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.717985    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-52t6g\""
Aug 04 09:13:21.718137 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.718070    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 09:13:21.718355 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.718337    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 09:13:21.718418 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.718388    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 09:13:21.723866 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.723837    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 09:13:21.733466 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.733429    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"]
Aug 04 09:13:21.868953 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.868916    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259b2b93-fabd-4dde-879c-265bb31963fa-tmp\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.869086 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.868952    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/259b2b93-fabd-4dde-879c-265bb31963fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.869086 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.868983    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/259b2b93-fabd-4dde-879c-265bb31963fa-manifests\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.869086 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.869065    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/259b2b93-fabd-4dde-879c-265bb31963fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.869192 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.869099    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcl75\" (UniqueName: \"kubernetes.io/projected/259b2b93-fabd-4dde-879c-265bb31963fa-kube-api-access-bcl75\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.970251 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.970185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259b2b93-fabd-4dde-879c-265bb31963fa-tmp\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.970251 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.970215    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/259b2b93-fabd-4dde-879c-265bb31963fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.970251 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.970248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/259b2b93-fabd-4dde-879c-265bb31963fa-manifests\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.970483 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.970281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/259b2b93-fabd-4dde-879c-265bb31963fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.970483 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.970312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcl75\" (UniqueName: \"kubernetes.io/projected/259b2b93-fabd-4dde-879c-265bb31963fa-kube-api-access-bcl75\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.970712 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.970691    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/259b2b93-fabd-4dde-879c-265bb31963fa-manifests\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.972805 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.972783    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259b2b93-fabd-4dde-879c-265bb31963fa-tmp\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.972898 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.972853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/259b2b93-fabd-4dde-879c-265bb31963fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.973070 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.973048    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/259b2b93-fabd-4dde-879c-265bb31963fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:21.984221 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:21.984193    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcl75\" (UniqueName: \"kubernetes.io/projected/259b2b93-fabd-4dde-879c-265bb31963fa-kube-api-access-bcl75\") pod \"opendatahub-operator-controller-manager-7c79dd6bb-crkj4\" (UID: \"259b2b93-fabd-4dde-879c-265bb31963fa\") " pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:22.024326 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:22.024302    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:22.161451 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:22.161419    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"]
Aug 04 09:13:22.163183 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:13:22.163153    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259b2b93_fabd_4dde_879c_265bb31963fa.slice/crio-7ecb8021532a9ffd5ca79ae750fb898d2fdeff3ffc46d124ed7595010e9a0083 WatchSource:0}: Error finding container 7ecb8021532a9ffd5ca79ae750fb898d2fdeff3ffc46d124ed7595010e9a0083: Status 404 returned error can't find the container with id 7ecb8021532a9ffd5ca79ae750fb898d2fdeff3ffc46d124ed7595010e9a0083
Aug 04 09:13:22.164887 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:22.164871    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 09:13:22.223185 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:22.223122    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4" event={"ID":"259b2b93-fabd-4dde-879c-265bb31963fa","Type":"ContainerStarted","Data":"7ecb8021532a9ffd5ca79ae750fb898d2fdeff3ffc46d124ed7595010e9a0083"}
Aug 04 09:13:26.242755 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:26.242708    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4" event={"ID":"259b2b93-fabd-4dde-879c-265bb31963fa","Type":"ContainerStarted","Data":"d4627e9b0834208ed031d3ea383a2500af4675b11625029ca33d3bfd4fda143b"}
Aug 04 09:13:27.248329 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:27.248290    2554 generic.go:356] "Generic (PLEG): container finished" podID="259b2b93-fabd-4dde-879c-265bb31963fa" containerID="d4627e9b0834208ed031d3ea383a2500af4675b11625029ca33d3bfd4fda143b" exitCode=0
Aug 04 09:13:27.248732 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:27.248370    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4" event={"ID":"259b2b93-fabd-4dde-879c-265bb31963fa","Type":"ContainerDied","Data":"d4627e9b0834208ed031d3ea383a2500af4675b11625029ca33d3bfd4fda143b"}
Aug 04 09:13:28.254782 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:28.254689    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4" event={"ID":"259b2b93-fabd-4dde-879c-265bb31963fa","Type":"ContainerStarted","Data":"9affce02c5a0108ae4411475ad8a7ec05cbffbac1ba6c985b52148611bc33c14"}
Aug 04 09:13:28.255135 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:28.254810    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:28.283632 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:28.283577    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4" podStartSLOduration=2.5144110360000003 podStartE2EDuration="7.283559044s" totalImagesPullingTime="3.767208693s" totalInitContainerRuntime="1.001939315s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:13:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:13:28.283058149 +0000 UTC m=+358.028464581" watchObservedRunningTime="2026-08-04 09:13:28.283559044 +0000 UTC m=+358.028965455"
Aug 04 09:13:39.260997 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:39.260963    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c79dd6bb-crkj4"
Aug 04 09:13:51.475339 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.475307    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"]
Aug 04 09:13:51.485798 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.485778    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.489980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.489775    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 09:13:51.489980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.489797    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 09:13:51.489980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.489775    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 09:13:51.489980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.489868    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 09:13:51.489980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.489775    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cbxtg\""
Aug 04 09:13:51.490309 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.490102    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 09:13:51.491712 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.491691    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"]
Aug 04 09:13:51.503150 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.503026    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xl4p\" (UniqueName: \"kubernetes.io/projected/c3c4d415-053b-461a-95c2-b7e6f7c3992e-kube-api-access-6xl4p\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.503150 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.503067    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3c4d415-053b-461a-95c2-b7e6f7c3992e-metrics-cert\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.503303 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.503157    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3c4d415-053b-461a-95c2-b7e6f7c3992e-manager-config\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.503303 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.503200    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3c4d415-053b-461a-95c2-b7e6f7c3992e-cert\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.603550 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.603504    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3c4d415-053b-461a-95c2-b7e6f7c3992e-manager-config\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.603550 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.603557    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3c4d415-053b-461a-95c2-b7e6f7c3992e-cert\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.603779 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.603584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xl4p\" (UniqueName: \"kubernetes.io/projected/c3c4d415-053b-461a-95c2-b7e6f7c3992e-kube-api-access-6xl4p\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.603779 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.603601    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3c4d415-053b-461a-95c2-b7e6f7c3992e-metrics-cert\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.604183 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.604161    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3c4d415-053b-461a-95c2-b7e6f7c3992e-manager-config\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.606267 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.606248    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3c4d415-053b-461a-95c2-b7e6f7c3992e-cert\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.606352 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.606292    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3c4d415-053b-461a-95c2-b7e6f7c3992e-metrics-cert\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.614149 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.614128    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xl4p\" (UniqueName: \"kubernetes.io/projected/c3c4d415-053b-461a-95c2-b7e6f7c3992e-kube-api-access-6xl4p\") pod \"lws-controller-manager-8856bf979-kgczp\" (UID: \"c3c4d415-053b-461a-95c2-b7e6f7c3992e\") " pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.796546 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.796451    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:51.953552 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:51.953528    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"]
Aug 04 09:13:51.955513 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:13:51.955480    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c4d415_053b_461a_95c2_b7e6f7c3992e.slice/crio-8239de894720ae9fc745774c794603b89026419382230f3e3111a55707394038 WatchSource:0}: Error finding container 8239de894720ae9fc745774c794603b89026419382230f3e3111a55707394038: Status 404 returned error can't find the container with id 8239de894720ae9fc745774c794603b89026419382230f3e3111a55707394038
Aug 04 09:13:52.354413 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:52.354380    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp" event={"ID":"c3c4d415-053b-461a-95c2-b7e6f7c3992e","Type":"ContainerStarted","Data":"8239de894720ae9fc745774c794603b89026419382230f3e3111a55707394038"}
Aug 04 09:13:53.893920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.893882    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"]
Aug 04 09:13:53.896261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.896238    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:53.906573 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.906550    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-v4dft\""
Aug 04 09:13:53.908308 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.908288    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 09:13:53.922390 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.922364    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2250e805-e385-42ce-bfe8-6c551571621e-cert\") pod \"kserve-controller-manager-d6f4b65b8-c7w2s\" (UID: \"2250e805-e385-42ce-bfe8-6c551571621e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:53.922521 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.922397    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtpb\" (UniqueName: \"kubernetes.io/projected/2250e805-e385-42ce-bfe8-6c551571621e-kube-api-access-9dtpb\") pod \"kserve-controller-manager-d6f4b65b8-c7w2s\" (UID: \"2250e805-e385-42ce-bfe8-6c551571621e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:53.939764 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.939732    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"]
Aug 04 09:13:53.941300 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.941276    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"]
Aug 04 09:13:53.943684 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.943665    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:53.948024 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.947976    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5x6sl\""
Aug 04 09:13:53.948136 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.948118    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 04 09:13:53.971577 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:53.971544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"]
Aug 04 09:13:54.023195 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.023158    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7qkd\" (UniqueName: \"kubernetes.io/projected/b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2-kube-api-access-g7qkd\") pod \"llmisvc-controller-manager-777c6bd7d5-8fr7q\" (UID: \"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:54.023374 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.023205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2250e805-e385-42ce-bfe8-6c551571621e-cert\") pod \"kserve-controller-manager-d6f4b65b8-c7w2s\" (UID: \"2250e805-e385-42ce-bfe8-6c551571621e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:54.023374 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.023232    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtpb\" (UniqueName: \"kubernetes.io/projected/2250e805-e385-42ce-bfe8-6c551571621e-kube-api-access-9dtpb\") pod \"kserve-controller-manager-d6f4b65b8-c7w2s\" (UID: \"2250e805-e385-42ce-bfe8-6c551571621e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:54.023374 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.023341    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8fr7q\" (UID: \"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:54.023567 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:13:54.023417    2554 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Aug 04 09:13:54.023567 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:13:54.023516    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2250e805-e385-42ce-bfe8-6c551571621e-cert podName:2250e805-e385-42ce-bfe8-6c551571621e nodeName:}" failed. No retries permitted until 2026-08-04 09:13:54.523494677 +0000 UTC m=+384.268901070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2250e805-e385-42ce-bfe8-6c551571621e-cert") pod "kserve-controller-manager-d6f4b65b8-c7w2s" (UID: "2250e805-e385-42ce-bfe8-6c551571621e") : secret "kserve-webhook-server-cert" not found
Aug 04 09:13:54.041991 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.041968    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtpb\" (UniqueName: \"kubernetes.io/projected/2250e805-e385-42ce-bfe8-6c551571621e-kube-api-access-9dtpb\") pod \"kserve-controller-manager-d6f4b65b8-c7w2s\" (UID: \"2250e805-e385-42ce-bfe8-6c551571621e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:54.124668 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.124594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7qkd\" (UniqueName: \"kubernetes.io/projected/b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2-kube-api-access-g7qkd\") pod \"llmisvc-controller-manager-777c6bd7d5-8fr7q\" (UID: \"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:54.125020 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.124729    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8fr7q\" (UID: \"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:54.127875 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.127851    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8fr7q\" (UID: \"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:54.145575 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.145504    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7qkd\" (UniqueName: \"kubernetes.io/projected/b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2-kube-api-access-g7qkd\") pod \"llmisvc-controller-manager-777c6bd7d5-8fr7q\" (UID: \"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:54.255983 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.255959    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:54.367162 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.367116    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp" event={"ID":"c3c4d415-053b-461a-95c2-b7e6f7c3992e","Type":"ContainerStarted","Data":"b836d6e36bafdefcbe2d4a8e121c85035533240b08f5cdace02f490bcfb3b38a"}
Aug 04 09:13:54.367339 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.367273    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:13:54.399432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.394186    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp" podStartSLOduration=1.12750505 podStartE2EDuration="3.39416509s" totalImagesPullingTime="2.26666004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:13:54.393830668 +0000 UTC m=+384.139237079" watchObservedRunningTime="2026-08-04 09:13:54.39416509 +0000 UTC m=+384.139571507"
Aug 04 09:13:54.409345 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.409316    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"]
Aug 04 09:13:54.411897 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:13:54.411865    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb2793dc0_8aea_4c53_8dea_4fd0dd66a3a2.slice/crio-3da7d1b7b08af4efcd7741e69bb288ee031ac2af798f0bb40c2b65c17c6d2c57 WatchSource:0}: Error finding container 3da7d1b7b08af4efcd7741e69bb288ee031ac2af798f0bb40c2b65c17c6d2c57: Status 404 returned error can't find the container with id 3da7d1b7b08af4efcd7741e69bb288ee031ac2af798f0bb40c2b65c17c6d2c57
Aug 04 09:13:54.527390 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.527354    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2250e805-e385-42ce-bfe8-6c551571621e-cert\") pod \"kserve-controller-manager-d6f4b65b8-c7w2s\" (UID: \"2250e805-e385-42ce-bfe8-6c551571621e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:54.529847 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.529829    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2250e805-e385-42ce-bfe8-6c551571621e-cert\") pod \"kserve-controller-manager-d6f4b65b8-c7w2s\" (UID: \"2250e805-e385-42ce-bfe8-6c551571621e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:54.808328 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.808298    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:54.942292 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:54.942268    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"]
Aug 04 09:13:54.944332 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:13:54.944303    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2250e805_e385_42ce_bfe8_6c551571621e.slice/crio-0792c11ed6a1e678ea77dd8ba9fad0fdd90bf27024f795500d1427cb52d5ef76 WatchSource:0}: Error finding container 0792c11ed6a1e678ea77dd8ba9fad0fdd90bf27024f795500d1427cb52d5ef76: Status 404 returned error can't find the container with id 0792c11ed6a1e678ea77dd8ba9fad0fdd90bf27024f795500d1427cb52d5ef76
Aug 04 09:13:55.373447 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:55.373409    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s" event={"ID":"2250e805-e385-42ce-bfe8-6c551571621e","Type":"ContainerStarted","Data":"0792c11ed6a1e678ea77dd8ba9fad0fdd90bf27024f795500d1427cb52d5ef76"}
Aug 04 09:13:55.374666 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:55.374640    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q" event={"ID":"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2","Type":"ContainerStarted","Data":"3da7d1b7b08af4efcd7741e69bb288ee031ac2af798f0bb40c2b65c17c6d2c57"}
Aug 04 09:13:59.395755 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:59.395714    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s" event={"ID":"2250e805-e385-42ce-bfe8-6c551571621e","Type":"ContainerStarted","Data":"7454be5a1bee561a4151458735b081b47f151b4f9ccba6b495c26355361dc122"}
Aug 04 09:13:59.396186 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:59.395830    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:13:59.397340 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:59.397317    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q" event={"ID":"b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2","Type":"ContainerStarted","Data":"c1479961744f6c782037c133d8ad9eee4e5ba3527847aa12c633a697d91c84ed"}
Aug 04 09:13:59.397439 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:59.397422    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:13:59.414806 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:59.414763    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s" podStartSLOduration=2.901618427 podStartE2EDuration="6.414746363s" totalImagesPullingTime="3.513127936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:13:59.413993328 +0000 UTC m=+389.159399738" watchObservedRunningTime="2026-08-04 09:13:59.414746363 +0000 UTC m=+389.160152773"
Aug 04 09:13:59.435608 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:13:59.435568    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q" podStartSLOduration=2.388940941 podStartE2EDuration="6.435554996s" totalImagesPullingTime="4.046614055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:13:59.434513865 +0000 UTC m=+389.179920275" watchObservedRunningTime="2026-08-04 09:13:59.435554996 +0000 UTC m=+389.180961407"
Aug 04 09:14:05.377704 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:14:05.377674    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8856bf979-kgczp"
Aug 04 09:14:30.403476 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:14:30.403428    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fr7q"
Aug 04 09:14:30.407001 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:14:30.406979    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c7w2s"
Aug 04 09:15:09.581269 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.581231    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"]
Aug 04 09:15:09.583401 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.583383    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.587004 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.586976    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 04 09:15:09.587120 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.587034    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 04 09:15:09.587120 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.587073    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fvztm\""
Aug 04 09:15:09.587309 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.587292    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 09:15:09.588180 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.588163    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 09:15:09.593855 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.593825    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"]
Aug 04 09:15:09.688167 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.688135    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50337210-396a-4194-bc0e-caf42c36629e-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.688312 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.688210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7g98\" (UniqueName: \"kubernetes.io/projected/50337210-396a-4194-bc0e-caf42c36629e-kube-api-access-k7g98\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.688312 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.688251    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50337210-396a-4194-bc0e-caf42c36629e-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.789358 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.789328    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50337210-396a-4194-bc0e-caf42c36629e-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.789358 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.789359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50337210-396a-4194-bc0e-caf42c36629e-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.789560 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.789405    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7g98\" (UniqueName: \"kubernetes.io/projected/50337210-396a-4194-bc0e-caf42c36629e-kube-api-access-k7g98\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.790112 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.790084    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50337210-396a-4194-bc0e-caf42c36629e-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.792015 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.791989    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50337210-396a-4194-bc0e-caf42c36629e-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.797554 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.797531    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7g98\" (UniqueName: \"kubernetes.io/projected/50337210-396a-4194-bc0e-caf42c36629e-kube-api-access-k7g98\") pod \"kuadrant-console-plugin-598f86468b-7l78s\" (UID: \"50337210-396a-4194-bc0e-caf42c36629e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:09.892918 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:09.892859    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"
Aug 04 09:15:10.024429 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:10.024403    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s"]
Aug 04 09:15:10.026735 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:15:10.026708    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50337210_396a_4194_bc0e_caf42c36629e.slice/crio-f4f29914677cbfd10c9b1614ca4378af3702fd4ba5bace1e74dd6655add7bf51 WatchSource:0}: Error finding container f4f29914677cbfd10c9b1614ca4378af3702fd4ba5bace1e74dd6655add7bf51: Status 404 returned error can't find the container with id f4f29914677cbfd10c9b1614ca4378af3702fd4ba5bace1e74dd6655add7bf51
Aug 04 09:15:10.704331 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:10.704300    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s" event={"ID":"50337210-396a-4194-bc0e-caf42c36629e","Type":"ContainerStarted","Data":"f4f29914677cbfd10c9b1614ca4378af3702fd4ba5bace1e74dd6655add7bf51"}
Aug 04 09:15:15.730376 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:15.730340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s" event={"ID":"50337210-396a-4194-bc0e-caf42c36629e","Type":"ContainerStarted","Data":"c43fec3185d4e60577454c229943c4b7ff17c027aee67230de440319696c7495"}
Aug 04 09:15:15.748331 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:15.748283    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-7l78s" podStartSLOduration=2.082628938 podStartE2EDuration="6.748262255s" totalImagesPullingTime="4.665633317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:15:15.747496878 +0000 UTC m=+465.492903303" watchObservedRunningTime="2026-08-04 09:15:15.748262255 +0000 UTC m=+465.493668667"
Aug 04 09:15:21.131501 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.131451    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"]
Aug 04 09:15:21.134179 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.134163    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.137614 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.137594    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9rh2j\""
Aug 04 09:15:21.149427 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.149404    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"]
Aug 04 09:15:21.281363 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.281331    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c808b5-fac8-41ad-b71b-b846c8f1ad98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-fgsqf\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.281533 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.281408    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf82j\" (UniqueName: \"kubernetes.io/projected/06c808b5-fac8-41ad-b71b-b846c8f1ad98-kube-api-access-tf82j\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-fgsqf\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.382715 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.382638    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf82j\" (UniqueName: \"kubernetes.io/projected/06c808b5-fac8-41ad-b71b-b846c8f1ad98-kube-api-access-tf82j\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-fgsqf\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.382849 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.382723    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c808b5-fac8-41ad-b71b-b846c8f1ad98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-fgsqf\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.383044 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.383028    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c808b5-fac8-41ad-b71b-b846c8f1ad98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-fgsqf\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.396822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.396800    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf82j\" (UniqueName: \"kubernetes.io/projected/06c808b5-fac8-41ad-b71b-b846c8f1ad98-kube-api-access-tf82j\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-fgsqf\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.444160 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.444133    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:21.579392 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.579368    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"]
Aug 04 09:15:21.581587 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:15:21.581562    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c808b5_fac8_41ad_b71b_b846c8f1ad98.slice/crio-558dcf076ea5652ada0675f91c8bd3f585cf460aaf7ddfa9593a9651a9e08d3d WatchSource:0}: Error finding container 558dcf076ea5652ada0675f91c8bd3f585cf460aaf7ddfa9593a9651a9e08d3d: Status 404 returned error can't find the container with id 558dcf076ea5652ada0675f91c8bd3f585cf460aaf7ddfa9593a9651a9e08d3d
Aug 04 09:15:21.756695 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:21.756603    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf" event={"ID":"06c808b5-fac8-41ad-b71b-b846c8f1ad98","Type":"ContainerStarted","Data":"558dcf076ea5652ada0675f91c8bd3f585cf460aaf7ddfa9593a9651a9e08d3d"}
Aug 04 09:15:25.782094 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:25.782059    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf" event={"ID":"06c808b5-fac8-41ad-b71b-b846c8f1ad98","Type":"ContainerStarted","Data":"25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a"}
Aug 04 09:15:25.782486 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:25.782155    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:15:25.804005 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:25.803956    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf" podStartSLOduration=1.1975134490000001 podStartE2EDuration="4.803941191s" totalImagesPullingTime="3.606427742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:15:25.801519984 +0000 UTC m=+475.546926395" watchObservedRunningTime="2026-08-04 09:15:25.803941191 +0000 UTC m=+475.549347602"
Aug 04 09:15:36.788797 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:15:36.788770    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:16:33.648800 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.648714    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fb65c789d-c6d47"]
Aug 04 09:16:33.651003 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.650984    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:33.653792 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.653774    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 09:16:33.653792 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.653783    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lf45h\""
Aug 04 09:16:33.655177 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.655164    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 09:16:33.661380 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.661354    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fb65c789d-c6d47"]
Aug 04 09:16:33.779150 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.779110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4debd500-5f29-4743-b489-c21445440fca-webhook-cert\") pod \"maas-controller-fb65c789d-c6d47\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") " pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:33.779338 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.779168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm9j4\" (UniqueName: \"kubernetes.io/projected/4debd500-5f29-4743-b489-c21445440fca-kube-api-access-sm9j4\") pod \"maas-controller-fb65c789d-c6d47\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") " pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:33.880596 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.880547    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4debd500-5f29-4743-b489-c21445440fca-webhook-cert\") pod \"maas-controller-fb65c789d-c6d47\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") " pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:33.880745 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.880618    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm9j4\" (UniqueName: \"kubernetes.io/projected/4debd500-5f29-4743-b489-c21445440fca-kube-api-access-sm9j4\") pod \"maas-controller-fb65c789d-c6d47\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") " pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:33.883276 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.883250    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4debd500-5f29-4743-b489-c21445440fca-webhook-cert\") pod \"maas-controller-fb65c789d-c6d47\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") " pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:33.890366 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.890338    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm9j4\" (UniqueName: \"kubernetes.io/projected/4debd500-5f29-4743-b489-c21445440fca-kube-api-access-sm9j4\") pod \"maas-controller-fb65c789d-c6d47\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") " pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:33.961877 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:33.961789    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:34.098676 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:34.098654    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fb65c789d-c6d47"]
Aug 04 09:16:34.100922 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:16:34.100884    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4debd500_5f29_4743_b489_c21445440fca.slice/crio-ab801fd9f7d7e38f20dac6e78d395ef8325641de74bd7902f5c65b35fb1f31a2 WatchSource:0}: Error finding container ab801fd9f7d7e38f20dac6e78d395ef8325641de74bd7902f5c65b35fb1f31a2: Status 404 returned error can't find the container with id ab801fd9f7d7e38f20dac6e78d395ef8325641de74bd7902f5c65b35fb1f31a2
Aug 04 09:16:35.086796 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:35.086743    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb65c789d-c6d47" event={"ID":"4debd500-5f29-4743-b489-c21445440fca","Type":"ContainerStarted","Data":"ab801fd9f7d7e38f20dac6e78d395ef8325641de74bd7902f5c65b35fb1f31a2"}
Aug 04 09:16:37.100882 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:37.100849    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb65c789d-c6d47" event={"ID":"4debd500-5f29-4743-b489-c21445440fca","Type":"ContainerStarted","Data":"e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220"}
Aug 04 09:16:37.101267 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:37.100907    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:16:37.118112 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:37.117981    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fb65c789d-c6d47" podStartSLOduration=1.900520658 podStartE2EDuration="4.117967269s" totalImagesPullingTime="2.217446611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:16:37.117712238 +0000 UTC m=+546.863118649" watchObservedRunningTime="2026-08-04 09:16:37.117967269 +0000 UTC m=+546.863373680"
Aug 04 09:16:48.108582 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:16:48.108550    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:17:12.128865 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.128827    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"]
Aug 04 09:17:12.131894 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.131875    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.135778 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.135756    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 04 09:17:12.135778 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.135775    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 09:17:12.136037 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.136024    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 09:17:12.148257 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.148227    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"]
Aug 04 09:17:12.169729 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.169701    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxjv\" (UniqueName: \"kubernetes.io/projected/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-kube-api-access-bnxjv\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.169866 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.169749    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-openshift-service-ca\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.169866 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.169770    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-maas-api-tls\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.270216 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.270180    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxjv\" (UniqueName: \"kubernetes.io/projected/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-kube-api-access-bnxjv\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.270377 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.270267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-openshift-service-ca\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.270377 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.270299    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-maas-api-tls\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.270450 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:17:12.270423    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Aug 04 09:17:12.270533 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:17:12.270521    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-maas-api-tls podName:d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082 nodeName:}" failed. No retries permitted until 2026-08-04 09:17:12.770499239 +0000 UTC m=+582.515905652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-maas-api-tls") pod "maas-api-6b95dff94b-zxsc4" (UID: "d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082") : secret "maas-api-serving-cert" not found
Aug 04 09:17:12.270975 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.270954    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-openshift-service-ca\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.280205 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.280171    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxjv\" (UniqueName: \"kubernetes.io/projected/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-kube-api-access-bnxjv\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.774039 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.774001    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-maas-api-tls\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:12.777172 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:12.777135    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082-maas-api-tls\") pod \"maas-api-6b95dff94b-zxsc4\" (UID: \"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082\") " pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:13.042691 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:13.042607    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:13.185755 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:13.185725    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"]
Aug 04 09:17:13.187774 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:17:13.187744    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24ca4b8_1f6e_4d63_a93c_1f4eb0daf082.slice/crio-78dfb67ea1e5fcd85256349b5f7bfbe7630be884264aa101bfcbcb74435730b0 WatchSource:0}: Error finding container 78dfb67ea1e5fcd85256349b5f7bfbe7630be884264aa101bfcbcb74435730b0: Status 404 returned error can't find the container with id 78dfb67ea1e5fcd85256349b5f7bfbe7630be884264aa101bfcbcb74435730b0
Aug 04 09:17:13.264161 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:13.264124    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4" event={"ID":"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082","Type":"ContainerStarted","Data":"78dfb67ea1e5fcd85256349b5f7bfbe7630be884264aa101bfcbcb74435730b0"}
Aug 04 09:17:15.276076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:15.276033    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4" event={"ID":"d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082","Type":"ContainerStarted","Data":"526b06a23a5e77121904f30a3705eea3caf52301c3726ad9b6414ca0445fbeb8"}
Aug 04 09:17:15.276504 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:15.276285    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:15.291693 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:15.291647    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4" podStartSLOduration=1.872580205 podStartE2EDuration="3.291632881s" totalImagesPullingTime="1.419052676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:17:15.290504366 +0000 UTC m=+585.035910776" watchObservedRunningTime="2026-08-04 09:17:15.291632881 +0000 UTC m=+585.037039291"
Aug 04 09:17:21.286427 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:21.286397    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b95dff94b-zxsc4"
Aug 04 09:17:30.696225 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:30.696190    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:17:30.703549 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:30.703515    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:17:30.703838 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:30.703821    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:17:30.716728 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:30.716700    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:17:36.296136 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.296103    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"]
Aug 04 09:17:36.299391 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.299375    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.302910 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.302888    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pfrgq\""
Aug 04 09:17:36.304099 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.304080    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 04 09:17:36.304099 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.304094    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 09:17:36.304269 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.304095    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 09:17:36.320675 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.320653    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"]
Aug 04 09:17:36.372511 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.372470    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.372685 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.372541    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.372685 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.372568    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.372685 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.372643    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.372685 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.372667    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945da735-2c75-4b30-839a-89d4982f7527-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.372904 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.372721    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nfbh\" (UniqueName: \"kubernetes.io/projected/945da735-2c75-4b30-839a-89d4982f7527-kube-api-access-5nfbh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474113 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474075    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474113 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474110    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945da735-2c75-4b30-839a-89d4982f7527-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474356 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474139    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nfbh\" (UniqueName: \"kubernetes.io/projected/945da735-2c75-4b30-839a-89d4982f7527-kube-api-access-5nfbh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474356 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474219    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474356 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474264    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474356 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474290    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474679 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474664    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474747 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474713    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.474843 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.474821    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.477316 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.477296    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/945da735-2c75-4b30-839a-89d4982f7527-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.477718 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.477677    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945da735-2c75-4b30-839a-89d4982f7527-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.482776 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.482754    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nfbh\" (UniqueName: \"kubernetes.io/projected/945da735-2c75-4b30-839a-89d4982f7527-kube-api-access-5nfbh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g\" (UID: \"945da735-2c75-4b30-839a-89d4982f7527\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.611544 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.611509    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:36.754330 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:36.754231    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"]
Aug 04 09:17:36.756420 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:17:36.756400    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945da735_2c75_4b30_839a_89d4982f7527.slice/crio-8f0a64bea8b0aa7391e3159a5df026ff554d703e2dce1015700ce90c83402396 WatchSource:0}: Error finding container 8f0a64bea8b0aa7391e3159a5df026ff554d703e2dce1015700ce90c83402396: Status 404 returned error can't find the container with id 8f0a64bea8b0aa7391e3159a5df026ff554d703e2dce1015700ce90c83402396
Aug 04 09:17:37.377933 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:37.377892    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g" event={"ID":"945da735-2c75-4b30-839a-89d4982f7527","Type":"ContainerStarted","Data":"8f0a64bea8b0aa7391e3159a5df026ff554d703e2dce1015700ce90c83402396"}
Aug 04 09:17:38.384151 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:38.384117    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g" event={"ID":"945da735-2c75-4b30-839a-89d4982f7527","Type":"ContainerStarted","Data":"c69e3f09d68b2e19072f3b3a93ec04843706c0b6ead01631a76c927af8826bca"}
Aug 04 09:17:38.402108 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:38.402054    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g" podStartSLOduration=1.257547537 podStartE2EDuration="2.402034099s" totalImagesPullingTime="1.144486562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:17:38.400610641 +0000 UTC m=+608.146017062" watchObservedRunningTime="2026-08-04 09:17:38.402034099 +0000 UTC m=+608.147440510"
Aug 04 09:17:46.612427 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:46.612392    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:46.612919 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:46.612495    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:46.625058 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:46.625034    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:47.437241 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:47.437207    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g"
Aug 04 09:17:59.235127 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.235096    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"]
Aug 04 09:17:59.238494 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.238450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.241304 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.241287    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 04 09:17:59.248882 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.248861    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"]
Aug 04 09:17:59.256804 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.256777    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.256933 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.256831    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.256933 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.256873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j748j\" (UniqueName: \"kubernetes.io/projected/ff0755fe-3234-4d05-bd1d-01d409df383e-kube-api-access-j748j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.257058 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.256970    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0755fe-3234-4d05-bd1d-01d409df383e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.257058 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.257019    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.257160 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.257086    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.357754 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.357723    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.357918 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.357764    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.357918 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.357792    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j748j\" (UniqueName: \"kubernetes.io/projected/ff0755fe-3234-4d05-bd1d-01d409df383e-kube-api-access-j748j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.357918 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.357825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0755fe-3234-4d05-bd1d-01d409df383e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.357918 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.357847    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.357918 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.357876    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.358245 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.358161    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.358245 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.358214    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.358316 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.358259    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.360285 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.360253    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff0755fe-3234-4d05-bd1d-01d409df383e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.360532 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.360515    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0755fe-3234-4d05-bd1d-01d409df383e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.366576 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.366556    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j748j\" (UniqueName: \"kubernetes.io/projected/ff0755fe-3234-4d05-bd1d-01d409df383e-kube-api-access-j748j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wxqfb\" (UID: \"ff0755fe-3234-4d05-bd1d-01d409df383e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.548744 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.548662    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:17:59.689582 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:17:59.689555    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"]
Aug 04 09:17:59.691664 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:17:59.691633    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0755fe_3234_4d05_bd1d_01d409df383e.slice/crio-48777f447ee47f44235c0ce7776e5521a818740426700812a431b3e7fdbc91e5 WatchSource:0}: Error finding container 48777f447ee47f44235c0ce7776e5521a818740426700812a431b3e7fdbc91e5: Status 404 returned error can't find the container with id 48777f447ee47f44235c0ce7776e5521a818740426700812a431b3e7fdbc91e5
Aug 04 09:18:00.494374 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:00.494336    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb" event={"ID":"ff0755fe-3234-4d05-bd1d-01d409df383e","Type":"ContainerStarted","Data":"84c9cf7af1b75b81477e4e8e0cfd090d045b8821ea9ab00336494eff9e5dae02"}
Aug 04 09:18:00.494857 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:00.494411    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb" event={"ID":"ff0755fe-3234-4d05-bd1d-01d409df383e","Type":"ContainerStarted","Data":"48777f447ee47f44235c0ce7776e5521a818740426700812a431b3e7fdbc91e5"}
Aug 04 09:18:00.518654 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:00.518605    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb" podStartSLOduration=1.319776068 podStartE2EDuration="1.518587049s" totalImagesPullingTime="198.810981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:18:00.5181406 +0000 UTC m=+630.263547011" watchObservedRunningTime="2026-08-04 09:18:00.518587049 +0000 UTC m=+630.263993461"
Aug 04 09:18:09.549393 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:09.549356    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:18:09.549809 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:09.549424    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:18:09.562107 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:09.562079    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:18:10.556840 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:10.556814    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wxqfb"
Aug 04 09:18:24.132151 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.132112    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"]
Aug 04 09:18:24.135629 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.135613    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.138443 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.138424    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 04 09:18:24.146675 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.146653    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"]
Aug 04 09:18:24.252064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.252027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.252064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.252077    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.252324 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.252099    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.252324 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.252155    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.252324 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.252215    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c085fd33-072c-4fee-b5f6-50a2bc8b817b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.252324 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.252278    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xkzw\" (UniqueName: \"kubernetes.io/projected/c085fd33-072c-4fee-b5f6-50a2bc8b817b-kube-api-access-2xkzw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.352826 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.352784    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.352826 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.352832    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.353080 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.352955    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.353080 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.353002    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.353080 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.353033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c085fd33-072c-4fee-b5f6-50a2bc8b817b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.353241 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.353124    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xkzw\" (UniqueName: \"kubernetes.io/projected/c085fd33-072c-4fee-b5f6-50a2bc8b817b-kube-api-access-2xkzw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.353241 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.353212    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.353241 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.353236    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.353406 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.353389    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.355398 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.355378    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c085fd33-072c-4fee-b5f6-50a2bc8b817b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.355523 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.355504    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c085fd33-072c-4fee-b5f6-50a2bc8b817b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.361776 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.361750    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xkzw\" (UniqueName: \"kubernetes.io/projected/c085fd33-072c-4fee-b5f6-50a2bc8b817b-kube-api-access-2xkzw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-62gbm\" (UID: \"c085fd33-072c-4fee-b5f6-50a2bc8b817b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.447418 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.447332    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:24.586631 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.586605    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"]
Aug 04 09:18:24.589069 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:18:24.589040    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc085fd33_072c_4fee_b5f6_50a2bc8b817b.slice/crio-12205b38ec05d3c70cff084ecf692421497bd917f1f8c41675964a247b85f3ac WatchSource:0}: Error finding container 12205b38ec05d3c70cff084ecf692421497bd917f1f8c41675964a247b85f3ac: Status 404 returned error can't find the container with id 12205b38ec05d3c70cff084ecf692421497bd917f1f8c41675964a247b85f3ac
Aug 04 09:18:24.590284 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.590269    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 09:18:24.609157 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:24.609120    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm" event={"ID":"c085fd33-072c-4fee-b5f6-50a2bc8b817b","Type":"ContainerStarted","Data":"12205b38ec05d3c70cff084ecf692421497bd917f1f8c41675964a247b85f3ac"}
Aug 04 09:18:25.616087 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:25.616046    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm" event={"ID":"c085fd33-072c-4fee-b5f6-50a2bc8b817b","Type":"ContainerStarted","Data":"625fc25fee8d206e7455ca2b87d311c638bd268e413d17ee4dc1fccf1978b2bc"}
Aug 04 09:18:25.636611 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:25.636561    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm" podStartSLOduration=1.432906604 podStartE2EDuration="1.636543879s" totalImagesPullingTime="203.637275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:18:25.635665959 +0000 UTC m=+655.381072382" watchObservedRunningTime="2026-08-04 09:18:25.636543879 +0000 UTC m=+655.381950290"
Aug 04 09:18:34.447721 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:34.447684    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:34.448233 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:34.447764    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:34.460275 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:34.460247    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:18:34.671199 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:18:34.671168    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-62gbm"
Aug 04 09:20:15.097085 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.097047    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fb65c789d-c6d47"]
Aug 04 09:20:15.097563 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.097277    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-fb65c789d-c6d47" podUID="4debd500-5f29-4743-b489-c21445440fca" containerName="manager" containerID="cri-o://e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220" gracePeriod=30
Aug 04 09:20:15.352581 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.352513    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:20:15.375726 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.375682    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4debd500-5f29-4743-b489-c21445440fca-webhook-cert\") pod \"4debd500-5f29-4743-b489-c21445440fca\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") "
Aug 04 09:20:15.375901 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.375751    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm9j4\" (UniqueName: \"kubernetes.io/projected/4debd500-5f29-4743-b489-c21445440fca-kube-api-access-sm9j4\") pod \"4debd500-5f29-4743-b489-c21445440fca\" (UID: \"4debd500-5f29-4743-b489-c21445440fca\") "
Aug 04 09:20:15.378338 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.378310    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4debd500-5f29-4743-b489-c21445440fca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4debd500-5f29-4743-b489-c21445440fca" (UID: "4debd500-5f29-4743-b489-c21445440fca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:20:15.378663 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.378642    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4debd500-5f29-4743-b489-c21445440fca-kube-api-access-sm9j4" (OuterVolumeSpecName: "kube-api-access-sm9j4") pod "4debd500-5f29-4743-b489-c21445440fca" (UID: "4debd500-5f29-4743-b489-c21445440fca"). InnerVolumeSpecName "kube-api-access-sm9j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:20:15.476504 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.476449    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm9j4\" (UniqueName: \"kubernetes.io/projected/4debd500-5f29-4743-b489-c21445440fca-kube-api-access-sm9j4\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:20:15.476504 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:15.476497    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4debd500-5f29-4743-b489-c21445440fca-webhook-cert\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:20:16.140062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.140025    2554 generic.go:356] "Generic (PLEG): container finished" podID="4debd500-5f29-4743-b489-c21445440fca" containerID="e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220" exitCode=0
Aug 04 09:20:16.140505 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.140066    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb65c789d-c6d47"
Aug 04 09:20:16.140505 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.140083    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb65c789d-c6d47" event={"ID":"4debd500-5f29-4743-b489-c21445440fca","Type":"ContainerDied","Data":"e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220"}
Aug 04 09:20:16.140505 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.140137    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb65c789d-c6d47" event={"ID":"4debd500-5f29-4743-b489-c21445440fca","Type":"ContainerDied","Data":"ab801fd9f7d7e38f20dac6e78d395ef8325641de74bd7902f5c65b35fb1f31a2"}
Aug 04 09:20:16.140505 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.140165    2554 scope.go:117] "RemoveContainer" containerID="e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220"
Aug 04 09:20:16.149628 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.149607    2554 scope.go:117] "RemoveContainer" containerID="e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220"
Aug 04 09:20:16.149897 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:20:16.149880    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220\": container with ID starting with e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220 not found: ID does not exist" containerID="e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220"
Aug 04 09:20:16.149951 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.149906    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220"} err="failed to get container status \"e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220\": rpc error: code = NotFound desc = could not find container \"e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220\": container with ID starting with e7efecbde3b13fdcb19af9bc789f1d3517989277bcdd40327315b209dc056220 not found: ID does not exist"
Aug 04 09:20:16.162850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.162825    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fb65c789d-c6d47"]
Aug 04 09:20:16.168697 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.168675    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fb65c789d-c6d47"]
Aug 04 09:20:16.781049 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:20:16.781012    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4debd500-5f29-4743-b489-c21445440fca" path="/var/lib/kubelet/pods/4debd500-5f29-4743-b489-c21445440fca/volumes"
Aug 04 09:22:30.732848 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:22:30.732767    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:22:30.740576 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:22:30.740545    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:22:30.744096 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:22:30.744071    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:22:30.748776 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:22:30.748754    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:27:30.767890 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:27:30.767857    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:27:30.771364 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:27:30.771341    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:27:30.775322 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:27:30.775290    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:27:30.779088 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:27:30.779063    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:28:05.252698 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.252654    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"]
Aug 04 09:28:05.253266 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.252996    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf" podUID="06c808b5-fac8-41ad-b71b-b846c8f1ad98" containerName="manager" containerID="cri-o://25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a" gracePeriod=10
Aug 04 09:28:05.510624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.510560    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:28:05.596995 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.596966    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf82j\" (UniqueName: \"kubernetes.io/projected/06c808b5-fac8-41ad-b71b-b846c8f1ad98-kube-api-access-tf82j\") pod \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") "
Aug 04 09:28:05.596995 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.597002    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c808b5-fac8-41ad-b71b-b846c8f1ad98-extensions-socket-volume\") pod \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\" (UID: \"06c808b5-fac8-41ad-b71b-b846c8f1ad98\") "
Aug 04 09:28:05.597390 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.597366    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c808b5-fac8-41ad-b71b-b846c8f1ad98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06c808b5-fac8-41ad-b71b-b846c8f1ad98" (UID: "06c808b5-fac8-41ad-b71b-b846c8f1ad98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:28:05.599251 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.599229    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c808b5-fac8-41ad-b71b-b846c8f1ad98-kube-api-access-tf82j" (OuterVolumeSpecName: "kube-api-access-tf82j") pod "06c808b5-fac8-41ad-b71b-b846c8f1ad98" (UID: "06c808b5-fac8-41ad-b71b-b846c8f1ad98"). InnerVolumeSpecName "kube-api-access-tf82j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:28:05.697893 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.697853    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf82j\" (UniqueName: \"kubernetes.io/projected/06c808b5-fac8-41ad-b71b-b846c8f1ad98-kube-api-access-tf82j\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:28:05.697893 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:05.697890    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06c808b5-fac8-41ad-b71b-b846c8f1ad98-extensions-socket-volume\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:28:06.319178 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.319140    2554 generic.go:356] "Generic (PLEG): container finished" podID="06c808b5-fac8-41ad-b71b-b846c8f1ad98" containerID="25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a" exitCode=0
Aug 04 09:28:06.319633 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.319184    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"
Aug 04 09:28:06.319633 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.319215    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf" event={"ID":"06c808b5-fac8-41ad-b71b-b846c8f1ad98","Type":"ContainerDied","Data":"25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a"}
Aug 04 09:28:06.319633 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.319263    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf" event={"ID":"06c808b5-fac8-41ad-b71b-b846c8f1ad98","Type":"ContainerDied","Data":"558dcf076ea5652ada0675f91c8bd3f585cf460aaf7ddfa9593a9651a9e08d3d"}
Aug 04 09:28:06.319633 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.319287    2554 scope.go:117] "RemoveContainer" containerID="25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a"
Aug 04 09:28:06.331811 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.331790    2554 scope.go:117] "RemoveContainer" containerID="25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a"
Aug 04 09:28:06.332074 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:28:06.332053    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a\": container with ID starting with 25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a not found: ID does not exist" containerID="25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a"
Aug 04 09:28:06.332116 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.332087    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a"} err="failed to get container status \"25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a\": rpc error: code = NotFound desc = could not find container \"25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a\": container with ID starting with 25da0a735ccebc70eaee9b2595f6a706b7448bd6c5e194c94964e773a1c1c60a not found: ID does not exist"
Aug 04 09:28:06.344348 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.344326    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"]
Aug 04 09:28:06.352541 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.352515    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-fgsqf"]
Aug 04 09:28:06.781041 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:28:06.780947    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c808b5-fac8-41ad-b71b-b846c8f1ad98" path="/var/lib/kubelet/pods/06c808b5-fac8-41ad-b71b-b846c8f1ad98/volumes"
Aug 04 09:29:05.960083 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.960048    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"]
Aug 04 09:29:05.960658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.960382    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c808b5-fac8-41ad-b71b-b846c8f1ad98" containerName="manager"
Aug 04 09:29:05.960658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.960395    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c808b5-fac8-41ad-b71b-b846c8f1ad98" containerName="manager"
Aug 04 09:29:05.960658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.960405    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4debd500-5f29-4743-b489-c21445440fca" containerName="manager"
Aug 04 09:29:05.960658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.960410    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4debd500-5f29-4743-b489-c21445440fca" containerName="manager"
Aug 04 09:29:05.960658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.960501    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c808b5-fac8-41ad-b71b-b846c8f1ad98" containerName="manager"
Aug 04 09:29:05.960658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.960510    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4debd500-5f29-4743-b489-c21445440fca" containerName="manager"
Aug 04 09:29:05.963279 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.963263    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:05.966182 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.966161    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9rh2j\""
Aug 04 09:29:05.973158 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.973138    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"]
Aug 04 09:29:05.993659 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.993630    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5g8d\" (UniqueName: \"kubernetes.io/projected/7524b774-7f90-4cb4-b827-92511e4d06c6-kube-api-access-c5g8d\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-h9pzv\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:05.993768 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:05.993673    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7524b774-7f90-4cb4-b827-92511e4d06c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-h9pzv\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:06.094846 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.094812    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5g8d\" (UniqueName: \"kubernetes.io/projected/7524b774-7f90-4cb4-b827-92511e4d06c6-kube-api-access-c5g8d\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-h9pzv\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:06.095010 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.094858    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7524b774-7f90-4cb4-b827-92511e4d06c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-h9pzv\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:06.095199 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.095182    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7524b774-7f90-4cb4-b827-92511e4d06c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-h9pzv\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:06.104309 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.104279    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5g8d\" (UniqueName: \"kubernetes.io/projected/7524b774-7f90-4cb4-b827-92511e4d06c6-kube-api-access-c5g8d\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-h9pzv\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:06.273585 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.273497    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:06.424934 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.424897    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"]
Aug 04 09:29:06.599890 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.599852    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv" event={"ID":"7524b774-7f90-4cb4-b827-92511e4d06c6","Type":"ContainerStarted","Data":"c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5"}
Aug 04 09:29:06.600081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.599911    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv" event={"ID":"7524b774-7f90-4cb4-b827-92511e4d06c6","Type":"ContainerStarted","Data":"8a31bb405c33337deaecf05602b96be23408feaceeb2630920106398133ada55"}
Aug 04 09:29:06.600081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.599985    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:29:06.627726 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:06.627678    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv" podStartSLOduration=1.627663101 podStartE2EDuration="1.627663101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:29:06.626153435 +0000 UTC m=+1296.371559846" watchObservedRunningTime="2026-08-04 09:29:06.627663101 +0000 UTC m=+1296.373069513"
Aug 04 09:29:17.607147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:29:17.607121    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:32:30.798818 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:32:30.798788    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:32:30.800005 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:32:30.799983    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:32:30.806320 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:32:30.806298    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:32:30.807288 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:32:30.807270    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:36:51.828384 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.828333    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"]
Aug 04 09:36:51.832299 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.832271    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:51.835340 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.835320    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e842246f-serving-cert\""
Aug 04 09:36:51.835480 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.835367    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:36:51.842775 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.842755    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"]
Aug 04 09:36:51.970429 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.970396    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh29t\" (UniqueName: \"kubernetes.io/projected/c6663651-8fa0-4558-a9ad-aa3e20208060-kube-api-access-rh29t\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:51.970593 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.970437    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6663651-8fa0-4558-a9ad-aa3e20208060-openshift-service-ca\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:51.970593 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:51.970482    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.071583 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.071549    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh29t\" (UniqueName: \"kubernetes.io/projected/c6663651-8fa0-4558-a9ad-aa3e20208060-kube-api-access-rh29t\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.071736 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.071594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6663651-8fa0-4558-a9ad-aa3e20208060-openshift-service-ca\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.071736 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.071636    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.071807 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:36:52.071738    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-serving-cert: secret "maas-api-e2e-ait-e842246f-serving-cert" not found
Aug 04 09:36:52.071807 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:36:52.071803    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls podName:c6663651-8fa0-4558-a9ad-aa3e20208060 nodeName:}" failed. No retries permitted until 2026-08-04 09:36:52.571783099 +0000 UTC m=+1762.317189488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls") pod "maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms" (UID: "c6663651-8fa0-4558-a9ad-aa3e20208060") : secret "maas-api-e2e-ait-e842246f-serving-cert" not found
Aug 04 09:36:52.072248 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.072228    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6663651-8fa0-4558-a9ad-aa3e20208060-openshift-service-ca\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.085269 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.085205    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh29t\" (UniqueName: \"kubernetes.io/projected/c6663651-8fa0-4558-a9ad-aa3e20208060-kube-api-access-rh29t\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.575844 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.575807    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.578507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.578475    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls\") pod \"maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:52.744078 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:52.744048    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:53.097422 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:53.097400    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"]
Aug 04 09:36:53.099563 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:36:53.099536    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6663651_8fa0_4558_a9ad_aa3e20208060.slice/crio-4d96b585a09aebc98293442e0ad365938da7261165435d4eef6fd6f7fc6a1a15 WatchSource:0}: Error finding container 4d96b585a09aebc98293442e0ad365938da7261165435d4eef6fd6f7fc6a1a15: Status 404 returned error can't find the container with id 4d96b585a09aebc98293442e0ad365938da7261165435d4eef6fd6f7fc6a1a15
Aug 04 09:36:53.101050 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:53.101035    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 09:36:53.776996 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:53.776957    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms" event={"ID":"c6663651-8fa0-4558-a9ad-aa3e20208060","Type":"ContainerStarted","Data":"4d96b585a09aebc98293442e0ad365938da7261165435d4eef6fd6f7fc6a1a15"}
Aug 04 09:36:54.783498 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:54.783431    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms" event={"ID":"c6663651-8fa0-4558-a9ad-aa3e20208060","Type":"ContainerStarted","Data":"540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4"}
Aug 04 09:36:54.783893 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:54.783564    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:36:54.800929 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:36:54.800877    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms" podStartSLOduration=3.203299 podStartE2EDuration="3.800861292s" totalImagesPullingTime="597.562292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:36:54.799589789 +0000 UTC m=+1764.544996203" watchObservedRunningTime="2026-08-04 09:36:54.800861292 +0000 UTC m=+1764.546267750"
Aug 04 09:37:00.793941 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:00.793912    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:37:30.827912 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:30.827878    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:37:30.828435 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:30.828155    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:37:30.834980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:30.834956    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:37:30.835391 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:30.835374    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:37:32.511584 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.511549    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"]
Aug 04 09:37:32.512004 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.511769    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms" podUID="c6663651-8fa0-4558-a9ad-aa3e20208060" containerName="maas-api" containerID="cri-o://540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4" gracePeriod=30
Aug 04 09:37:32.760057 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.760027    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:37:32.832707 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.832679    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6663651-8fa0-4558-a9ad-aa3e20208060-openshift-service-ca\") pod \"c6663651-8fa0-4558-a9ad-aa3e20208060\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") "
Aug 04 09:37:32.832870 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.832724    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls\") pod \"c6663651-8fa0-4558-a9ad-aa3e20208060\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") "
Aug 04 09:37:32.832870 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.832785    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh29t\" (UniqueName: \"kubernetes.io/projected/c6663651-8fa0-4558-a9ad-aa3e20208060-kube-api-access-rh29t\") pod \"c6663651-8fa0-4558-a9ad-aa3e20208060\" (UID: \"c6663651-8fa0-4558-a9ad-aa3e20208060\") "
Aug 04 09:37:32.833108 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.833084    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6663651-8fa0-4558-a9ad-aa3e20208060-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6663651-8fa0-4558-a9ad-aa3e20208060" (UID: "c6663651-8fa0-4558-a9ad-aa3e20208060"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:37:32.833180 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.833160    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6663651-8fa0-4558-a9ad-aa3e20208060-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:37:32.835136 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.835109    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6663651-8fa0-4558-a9ad-aa3e20208060-kube-api-access-rh29t" (OuterVolumeSpecName: "kube-api-access-rh29t") pod "c6663651-8fa0-4558-a9ad-aa3e20208060" (UID: "c6663651-8fa0-4558-a9ad-aa3e20208060"). InnerVolumeSpecName "kube-api-access-rh29t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:37:32.835232 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.835195    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6663651-8fa0-4558-a9ad-aa3e20208060" (UID: "c6663651-8fa0-4558-a9ad-aa3e20208060"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:37:32.934641 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.934606    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6663651-8fa0-4558-a9ad-aa3e20208060-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:37:32.934641 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.934643    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh29t\" (UniqueName: \"kubernetes.io/projected/c6663651-8fa0-4558-a9ad-aa3e20208060-kube-api-access-rh29t\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:37:32.964681 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.964652    2554 generic.go:356] "Generic (PLEG): container finished" podID="c6663651-8fa0-4558-a9ad-aa3e20208060" containerID="540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4" exitCode=0
Aug 04 09:37:32.964830 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.964696    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"
Aug 04 09:37:32.964830 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.964733    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms" event={"ID":"c6663651-8fa0-4558-a9ad-aa3e20208060","Type":"ContainerDied","Data":"540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4"}
Aug 04 09:37:32.964830 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.964793    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms" event={"ID":"c6663651-8fa0-4558-a9ad-aa3e20208060","Type":"ContainerDied","Data":"4d96b585a09aebc98293442e0ad365938da7261165435d4eef6fd6f7fc6a1a15"}
Aug 04 09:37:32.964830 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.964821    2554 scope.go:117] "RemoveContainer" containerID="540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4"
Aug 04 09:37:32.974707 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.974682    2554 scope.go:117] "RemoveContainer" containerID="540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4"
Aug 04 09:37:32.975038 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:37:32.975011    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4\": container with ID starting with 540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4 not found: ID does not exist" containerID="540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4"
Aug 04 09:37:32.975124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.975050    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4"} err="failed to get container status \"540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4\": rpc error: code = NotFound desc = could not find container \"540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4\": container with ID starting with 540e1897fd2bdbeace661c7914564e27c1aaed6f84a12a4d8ee4b81377a1abf4 not found: ID does not exist"
Aug 04 09:37:32.988888 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.988859    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"]
Aug 04 09:37:32.992677 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:32.992655    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e842246f-6d9d5c4d96-5jqms"]
Aug 04 09:37:34.782172 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:34.782131    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6663651-8fa0-4558-a9ad-aa3e20208060" path="/var/lib/kubelet/pods/c6663651-8fa0-4558-a9ad-aa3e20208060/volumes"
Aug 04 09:37:37.252021 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.251979    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"]
Aug 04 09:37:37.252628 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.252319    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6663651-8fa0-4558-a9ad-aa3e20208060" containerName="maas-api"
Aug 04 09:37:37.252628 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.252329    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6663651-8fa0-4558-a9ad-aa3e20208060" containerName="maas-api"
Aug 04 09:37:37.252628 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.252408    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6663651-8fa0-4558-a9ad-aa3e20208060" containerName="maas-api"
Aug 04 09:37:37.256912 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.256893    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.259615 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.259592    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-93164817-serving-cert\""
Aug 04 09:37:37.259615 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.259602    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:37:37.266147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.266115    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"]
Aug 04 09:37:37.374913 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.374876    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3efd77ff-4ca9-4c9e-b639-474e914de7e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.375071 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.374950    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3efd77ff-4ca9-4c9e-b639-474e914de7e6-maas-api-tls\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.375071 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.374988    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965t6\" (UniqueName: \"kubernetes.io/projected/3efd77ff-4ca9-4c9e-b639-474e914de7e6-kube-api-access-965t6\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.475354 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.475325    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-965t6\" (UniqueName: \"kubernetes.io/projected/3efd77ff-4ca9-4c9e-b639-474e914de7e6-kube-api-access-965t6\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.475639 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.475379    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3efd77ff-4ca9-4c9e-b639-474e914de7e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.475639 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.475435    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3efd77ff-4ca9-4c9e-b639-474e914de7e6-maas-api-tls\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.476239 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.476199    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3efd77ff-4ca9-4c9e-b639-474e914de7e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.478181 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.478162    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3efd77ff-4ca9-4c9e-b639-474e914de7e6-maas-api-tls\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.484604 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.484581    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-965t6\" (UniqueName: \"kubernetes.io/projected/3efd77ff-4ca9-4c9e-b639-474e914de7e6-kube-api-access-965t6\") pod \"maas-api-e2e-migrate-93164817-6866f946c5-g6ttf\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.568828 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.568796    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:37.713208 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.713182    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"]
Aug 04 09:37:37.715260 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:37:37.715235    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efd77ff_4ca9_4c9e_b639_474e914de7e6.slice/crio-9d2d78f2b48bee8ca16922ca13616d1ad7c39f86878d54331bad19ac83d4cd9c WatchSource:0}: Error finding container 9d2d78f2b48bee8ca16922ca13616d1ad7c39f86878d54331bad19ac83d4cd9c: Status 404 returned error can't find the container with id 9d2d78f2b48bee8ca16922ca13616d1ad7c39f86878d54331bad19ac83d4cd9c
Aug 04 09:37:37.996864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:37.996790    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf" event={"ID":"3efd77ff-4ca9-4c9e-b639-474e914de7e6","Type":"ContainerStarted","Data":"9d2d78f2b48bee8ca16922ca13616d1ad7c39f86878d54331bad19ac83d4cd9c"}
Aug 04 09:37:39.005082 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:39.005041    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf" event={"ID":"3efd77ff-4ca9-4c9e-b639-474e914de7e6","Type":"ContainerStarted","Data":"dcb3b3dee39caf17a14c503b293ae877dab8bcb20d2b0db9324a623320f8eb69"}
Aug 04 09:37:39.005474 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:39.005206    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:37:39.022676 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:39.022625    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf" podStartSLOduration=1.64764405 podStartE2EDuration="2.02260701s" totalImagesPullingTime="374.96296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:37:39.02227291 +0000 UTC m=+1808.767679323" watchObservedRunningTime="2026-08-04 09:37:39.02260701 +0000 UTC m=+1808.768013421"
Aug 04 09:37:45.016772 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:37:45.016745    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:38:17.950293 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:17.950255    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"]
Aug 04 09:38:17.950784 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:17.950514    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf" podUID="3efd77ff-4ca9-4c9e-b639-474e914de7e6" containerName="maas-api" containerID="cri-o://dcb3b3dee39caf17a14c503b293ae877dab8bcb20d2b0db9324a623320f8eb69" gracePeriod=30
Aug 04 09:38:18.192713 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.192673    2554 generic.go:356] "Generic (PLEG): container finished" podID="3efd77ff-4ca9-4c9e-b639-474e914de7e6" containerID="dcb3b3dee39caf17a14c503b293ae877dab8bcb20d2b0db9324a623320f8eb69" exitCode=0
Aug 04 09:38:18.192862 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.192740    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf" event={"ID":"3efd77ff-4ca9-4c9e-b639-474e914de7e6","Type":"ContainerDied","Data":"dcb3b3dee39caf17a14c503b293ae877dab8bcb20d2b0db9324a623320f8eb69"}
Aug 04 09:38:18.209224 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.209174    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:38:18.309869 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.309838    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3efd77ff-4ca9-4c9e-b639-474e914de7e6-openshift-service-ca\") pod \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") "
Aug 04 09:38:18.310054 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.309893    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3efd77ff-4ca9-4c9e-b639-474e914de7e6-maas-api-tls\") pod \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") "
Aug 04 09:38:18.310054 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.309960    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-965t6\" (UniqueName: \"kubernetes.io/projected/3efd77ff-4ca9-4c9e-b639-474e914de7e6-kube-api-access-965t6\") pod \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\" (UID: \"3efd77ff-4ca9-4c9e-b639-474e914de7e6\") "
Aug 04 09:38:18.310319 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.310280    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3efd77ff-4ca9-4c9e-b639-474e914de7e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3efd77ff-4ca9-4c9e-b639-474e914de7e6" (UID: "3efd77ff-4ca9-4c9e-b639-474e914de7e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:38:18.313060 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.313032    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efd77ff-4ca9-4c9e-b639-474e914de7e6-kube-api-access-965t6" (OuterVolumeSpecName: "kube-api-access-965t6") pod "3efd77ff-4ca9-4c9e-b639-474e914de7e6" (UID: "3efd77ff-4ca9-4c9e-b639-474e914de7e6"). InnerVolumeSpecName "kube-api-access-965t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:38:18.313166 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.313083    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3efd77ff-4ca9-4c9e-b639-474e914de7e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3efd77ff-4ca9-4c9e-b639-474e914de7e6" (UID: "3efd77ff-4ca9-4c9e-b639-474e914de7e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:38:18.411304 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.411271    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-965t6\" (UniqueName: \"kubernetes.io/projected/3efd77ff-4ca9-4c9e-b639-474e914de7e6-kube-api-access-965t6\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:38:18.411304 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.411300    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3efd77ff-4ca9-4c9e-b639-474e914de7e6-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:38:18.411304 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:18.411310    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3efd77ff-4ca9-4c9e-b639-474e914de7e6-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:38:19.200436 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:19.200398    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf" event={"ID":"3efd77ff-4ca9-4c9e-b639-474e914de7e6","Type":"ContainerDied","Data":"9d2d78f2b48bee8ca16922ca13616d1ad7c39f86878d54331bad19ac83d4cd9c"}
Aug 04 09:38:19.200865 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:19.200482    2554 scope.go:117] "RemoveContainer" containerID="dcb3b3dee39caf17a14c503b293ae877dab8bcb20d2b0db9324a623320f8eb69"
Aug 04 09:38:19.200865 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:19.200411    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"
Aug 04 09:38:19.229432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:19.229405    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"]
Aug 04 09:38:19.238065 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:19.238041    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-93164817-6866f946c5-g6ttf"]
Aug 04 09:38:20.783574 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:20.783538    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efd77ff-4ca9-4c9e-b639-474e914de7e6" path="/var/lib/kubelet/pods/3efd77ff-4ca9-4c9e-b639-474e914de7e6/volumes"
Aug 04 09:38:22.793006 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.792970    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"]
Aug 04 09:38:22.793397 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.793321    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efd77ff-4ca9-4c9e-b639-474e914de7e6" containerName="maas-api"
Aug 04 09:38:22.793397 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.793331    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efd77ff-4ca9-4c9e-b639-474e914de7e6" containerName="maas-api"
Aug 04 09:38:22.793498 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.793411    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efd77ff-4ca9-4c9e-b639-474e914de7e6" containerName="maas-api"
Aug 04 09:38:22.798000 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.797976    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.800938 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.800801    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:38:22.800938 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.800833    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d6e1c0f5-serving-cert\""
Aug 04 09:38:22.808292 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.808266    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"]
Aug 04 09:38:22.846834 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.846805    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.846958 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.846899    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdeaee19-5fe0-4c06-83e9-f640424d66fd-openshift-service-ca\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.846958 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.846947    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts6c7\" (UniqueName: \"kubernetes.io/projected/cdeaee19-5fe0-4c06-83e9-f640424d66fd-kube-api-access-ts6c7\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.948441 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.948410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.948625 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.948497    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdeaee19-5fe0-4c06-83e9-f640424d66fd-openshift-service-ca\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.948625 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.948528    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts6c7\" (UniqueName: \"kubernetes.io/projected/cdeaee19-5fe0-4c06-83e9-f640424d66fd-kube-api-access-ts6c7\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.948625 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:38:22.948569    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-serving-cert: secret "maas-api-e2e-ait-d6e1c0f5-serving-cert" not found
Aug 04 09:38:22.948792 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:38:22.948656    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls podName:cdeaee19-5fe0-4c06-83e9-f640424d66fd nodeName:}" failed. No retries permitted until 2026-08-04 09:38:23.448630246 +0000 UTC m=+1853.194036653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls") pod "maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4" (UID: "cdeaee19-5fe0-4c06-83e9-f640424d66fd") : secret "maas-api-e2e-ait-d6e1c0f5-serving-cert" not found
Aug 04 09:38:22.949133 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.949107    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdeaee19-5fe0-4c06-83e9-f640424d66fd-openshift-service-ca\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:22.964381 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:22.964357    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts6c7\" (UniqueName: \"kubernetes.io/projected/cdeaee19-5fe0-4c06-83e9-f640424d66fd-kube-api-access-ts6c7\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:23.453918 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:23.453882    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:23.456445 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:23.456414    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls\") pod \"maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:23.709639 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:23.709548    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:23.851293 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:23.851265    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"]
Aug 04 09:38:23.853513 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:38:23.853484    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdeaee19_5fe0_4c06_83e9_f640424d66fd.slice/crio-59df772188025ce47083cb365ea5fbb4928e86948cc2203de4269fe9442c6f04 WatchSource:0}: Error finding container 59df772188025ce47083cb365ea5fbb4928e86948cc2203de4269fe9442c6f04: Status 404 returned error can't find the container with id 59df772188025ce47083cb365ea5fbb4928e86948cc2203de4269fe9442c6f04
Aug 04 09:38:24.225275 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:24.225238    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4" event={"ID":"cdeaee19-5fe0-4c06-83e9-f640424d66fd","Type":"ContainerStarted","Data":"59df772188025ce47083cb365ea5fbb4928e86948cc2203de4269fe9442c6f04"}
Aug 04 09:38:25.231123 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:25.231082    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4" event={"ID":"cdeaee19-5fe0-4c06-83e9-f640424d66fd","Type":"ContainerStarted","Data":"a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20"}
Aug 04 09:38:25.231599 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:25.231198    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:25.251001 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:25.250956    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4" podStartSLOduration=2.911574271 podStartE2EDuration="3.25094072s" totalImagesPullingTime="339.366449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:38:25.24939509 +0000 UTC m=+1854.994801503" watchObservedRunningTime="2026-08-04 09:38:25.25094072 +0000 UTC m=+1854.996347131"
Aug 04 09:38:31.241128 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:31.241047    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:53.417315 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.417278    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"]
Aug 04 09:38:53.417855 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.417672    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4" podUID="cdeaee19-5fe0-4c06-83e9-f640424d66fd" containerName="maas-api" containerID="cri-o://a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20" gracePeriod=30
Aug 04 09:38:53.675214 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.675148    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:53.719739 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.719706    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts6c7\" (UniqueName: \"kubernetes.io/projected/cdeaee19-5fe0-4c06-83e9-f640424d66fd-kube-api-access-ts6c7\") pod \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") "
Aug 04 09:38:53.719889 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.719789    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdeaee19-5fe0-4c06-83e9-f640424d66fd-openshift-service-ca\") pod \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") "
Aug 04 09:38:53.719889 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.719840    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls\") pod \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\" (UID: \"cdeaee19-5fe0-4c06-83e9-f640424d66fd\") "
Aug 04 09:38:53.720225 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.720194    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdeaee19-5fe0-4c06-83e9-f640424d66fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cdeaee19-5fe0-4c06-83e9-f640424d66fd" (UID: "cdeaee19-5fe0-4c06-83e9-f640424d66fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:38:53.722085 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.722058    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdeaee19-5fe0-4c06-83e9-f640424d66fd-kube-api-access-ts6c7" (OuterVolumeSpecName: "kube-api-access-ts6c7") pod "cdeaee19-5fe0-4c06-83e9-f640424d66fd" (UID: "cdeaee19-5fe0-4c06-83e9-f640424d66fd"). InnerVolumeSpecName "kube-api-access-ts6c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:38:53.722085 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.722066    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cdeaee19-5fe0-4c06-83e9-f640424d66fd" (UID: "cdeaee19-5fe0-4c06-83e9-f640424d66fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:38:53.821062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.821028    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdeaee19-5fe0-4c06-83e9-f640424d66fd-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:38:53.821062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.821060    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts6c7\" (UniqueName: \"kubernetes.io/projected/cdeaee19-5fe0-4c06-83e9-f640424d66fd-kube-api-access-ts6c7\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:38:53.821062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:53.821070    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdeaee19-5fe0-4c06-83e9-f640424d66fd-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:38:54.367420 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.367388    2554 generic.go:356] "Generic (PLEG): container finished" podID="cdeaee19-5fe0-4c06-83e9-f640424d66fd" containerID="a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20" exitCode=0
Aug 04 09:38:54.367624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.367433    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"
Aug 04 09:38:54.367624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.367482    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4" event={"ID":"cdeaee19-5fe0-4c06-83e9-f640424d66fd","Type":"ContainerDied","Data":"a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20"}
Aug 04 09:38:54.367624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.367538    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4" event={"ID":"cdeaee19-5fe0-4c06-83e9-f640424d66fd","Type":"ContainerDied","Data":"59df772188025ce47083cb365ea5fbb4928e86948cc2203de4269fe9442c6f04"}
Aug 04 09:38:54.367624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.367561    2554 scope.go:117] "RemoveContainer" containerID="a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20"
Aug 04 09:38:54.377001 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.376984    2554 scope.go:117] "RemoveContainer" containerID="a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20"
Aug 04 09:38:54.377289 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:38:54.377269    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20\": container with ID starting with a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20 not found: ID does not exist" containerID="a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20"
Aug 04 09:38:54.377353 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.377296    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20"} err="failed to get container status \"a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20\": rpc error: code = NotFound desc = could not find container \"a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20\": container with ID starting with a829ee67611719a41c93376ebb76c74a9c22a59a642b609dac2718892d58da20 not found: ID does not exist"
Aug 04 09:38:54.389249 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.389226    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"]
Aug 04 09:38:54.393666 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.393643    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6e1c0f5-85c8c8d847-hjwq4"]
Aug 04 09:38:54.782014 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:54.781926    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdeaee19-5fe0-4c06-83e9-f640424d66fd" path="/var/lib/kubelet/pods/cdeaee19-5fe0-4c06-83e9-f640424d66fd/volumes"
Aug 04 09:38:59.676870 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.676835    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"]
Aug 04 09:38:59.677443 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.677238    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdeaee19-5fe0-4c06-83e9-f640424d66fd" containerName="maas-api"
Aug 04 09:38:59.677443 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.677249    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdeaee19-5fe0-4c06-83e9-f640424d66fd" containerName="maas-api"
Aug 04 09:38:59.677443 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.677334    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdeaee19-5fe0-4c06-83e9-f640424d66fd" containerName="maas-api"
Aug 04 09:38:59.681815 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.681793    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.684580 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.684547    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-cf8d7038-serving-cert\""
Aug 04 09:38:59.684580 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.684575    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:38:59.697175 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.697149    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"]
Aug 04 09:38:59.770806 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.770772    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-maas-api-tls\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.770806 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.770808    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-openshift-service-ca\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.770996 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.770833    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmqn\" (UniqueName: \"kubernetes.io/projected/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-kube-api-access-gpmqn\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.871680 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.871637    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-maas-api-tls\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.871680 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.871682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-openshift-service-ca\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.871946 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.871705    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmqn\" (UniqueName: \"kubernetes.io/projected/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-kube-api-access-gpmqn\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.872349 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.872320    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-openshift-service-ca\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.874497 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.874473    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-maas-api-tls\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.880437 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.880403    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmqn\" (UniqueName: \"kubernetes.io/projected/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-kube-api-access-gpmqn\") pod \"maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:38:59.992610 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:38:59.992531    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:39:00.166331 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:00.166303    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"]
Aug 04 09:39:00.168559 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:39:00.168529    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0293b1_0ee6_4245_9dc9_b8cc0a064e63.slice/crio-08410d7f715c37ff8d99853f41a286d80af8fa7ba188c2b5e540bdccd3f2b55c WatchSource:0}: Error finding container 08410d7f715c37ff8d99853f41a286d80af8fa7ba188c2b5e540bdccd3f2b55c: Status 404 returned error can't find the container with id 08410d7f715c37ff8d99853f41a286d80af8fa7ba188c2b5e540bdccd3f2b55c
Aug 04 09:39:00.403297 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:00.403249    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc" event={"ID":"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63","Type":"ContainerStarted","Data":"08410d7f715c37ff8d99853f41a286d80af8fa7ba188c2b5e540bdccd3f2b55c"}
Aug 04 09:39:01.411627 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:01.411582    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc" event={"ID":"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63","Type":"ContainerStarted","Data":"8ce7d80eda9a2bc822445a0e12d08687b456d5197bc3bb77797c0707b19254bb"}
Aug 04 09:39:01.412030 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:01.411658    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:39:01.429747 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:01.429689    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc" podStartSLOduration=2.016561865 podStartE2EDuration="2.429671487s" totalImagesPullingTime="413.109622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:39:01.42895019 +0000 UTC m=+1891.174356602" watchObservedRunningTime="2026-08-04 09:39:01.429671487 +0000 UTC m=+1891.175077902"
Aug 04 09:39:07.421779 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:07.421746    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:39:30.307043 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.306996    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"]
Aug 04 09:39:30.307555 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.307254    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc" podUID="bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" containerName="maas-api" containerID="cri-o://8ce7d80eda9a2bc822445a0e12d08687b456d5197bc3bb77797c0707b19254bb" gracePeriod=30
Aug 04 09:39:30.549966 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.549934    2554 generic.go:356] "Generic (PLEG): container finished" podID="bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" containerID="8ce7d80eda9a2bc822445a0e12d08687b456d5197bc3bb77797c0707b19254bb" exitCode=0
Aug 04 09:39:30.550139 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.550022    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc" event={"ID":"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63","Type":"ContainerDied","Data":"8ce7d80eda9a2bc822445a0e12d08687b456d5197bc3bb77797c0707b19254bb"}
Aug 04 09:39:30.550139 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.550115    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc" event={"ID":"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63","Type":"ContainerDied","Data":"08410d7f715c37ff8d99853f41a286d80af8fa7ba188c2b5e540bdccd3f2b55c"}
Aug 04 09:39:30.550254 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.550160    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08410d7f715c37ff8d99853f41a286d80af8fa7ba188c2b5e540bdccd3f2b55c"
Aug 04 09:39:30.561351 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.561329    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:39:30.646980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.646946    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpmqn\" (UniqueName: \"kubernetes.io/projected/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-kube-api-access-gpmqn\") pod \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") "
Aug 04 09:39:30.647173 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.647022    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-maas-api-tls\") pod \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") "
Aug 04 09:39:30.647173 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.647050    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-openshift-service-ca\") pod \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\" (UID: \"bd0293b1-0ee6-4245-9dc9-b8cc0a064e63\") "
Aug 04 09:39:30.647659 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.647611    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" (UID: "bd0293b1-0ee6-4245-9dc9-b8cc0a064e63"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:39:30.651514 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.651470    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-kube-api-access-gpmqn" (OuterVolumeSpecName: "kube-api-access-gpmqn") pod "bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" (UID: "bd0293b1-0ee6-4245-9dc9-b8cc0a064e63"). InnerVolumeSpecName "kube-api-access-gpmqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:39:30.652219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.652192    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" (UID: "bd0293b1-0ee6-4245-9dc9-b8cc0a064e63"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:39:30.748565 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.748530    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpmqn\" (UniqueName: \"kubernetes.io/projected/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-kube-api-access-gpmqn\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:39:30.748565 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.748559    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:39:30.748565 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:30.748568    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:39:31.555406 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:31.555371    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"
Aug 04 09:39:31.580251 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:31.580214    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"]
Aug 04 09:39:31.586320 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:31.586293    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cf8d7038-7b4f5c7cf-lr8zc"]
Aug 04 09:39:32.780894 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:39:32.780857    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" path="/var/lib/kubelet/pods/bd0293b1-0ee6-4245-9dc9-b8cc0a064e63/volumes"
Aug 04 09:41:34.357546 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.357505    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"]
Aug 04 09:41:34.358020 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.357909    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" containerName="maas-api"
Aug 04 09:41:34.358020 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.357922    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" containerName="maas-api"
Aug 04 09:41:34.358020 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.357989    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0293b1-0ee6-4245-9dc9-b8cc0a064e63" containerName="maas-api"
Aug 04 09:41:34.361288 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.361267    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.363860 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.363833    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ea2eafd7-serving-cert\""
Aug 04 09:41:34.364036 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.364013    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:41:34.372225 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.372199    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"]
Aug 04 09:41:34.480126 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.480088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjzhd\" (UniqueName: \"kubernetes.io/projected/f7c28479-f151-4bbd-bc85-1653f5fc8819-kube-api-access-tjzhd\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.480312 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.480151    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.480312 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.480182    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c28479-f151-4bbd-bc85-1653f5fc8819-openshift-service-ca\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.581408 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.581370    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjzhd\" (UniqueName: \"kubernetes.io/projected/f7c28479-f151-4bbd-bc85-1653f5fc8819-kube-api-access-tjzhd\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.581602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.581431    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.581602 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:41:34.581546    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-serving-cert: secret "maas-api-e2e-mt-ea2eafd7-serving-cert" not found
Aug 04 09:41:34.581602 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:41:34.581600    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls podName:f7c28479-f151-4bbd-bc85-1653f5fc8819 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:35.081579148 +0000 UTC m=+2044.826985536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls") pod "maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp" (UID: "f7c28479-f151-4bbd-bc85-1653f5fc8819") : secret "maas-api-e2e-mt-ea2eafd7-serving-cert" not found
Aug 04 09:41:34.581768 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.581616    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c28479-f151-4bbd-bc85-1653f5fc8819-openshift-service-ca\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.582176 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.582158    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c28479-f151-4bbd-bc85-1653f5fc8819-openshift-service-ca\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:34.590845 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:34.590817    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjzhd\" (UniqueName: \"kubernetes.io/projected/f7c28479-f151-4bbd-bc85-1653f5fc8819-kube-api-access-tjzhd\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:35.087426 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:35.087387    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:35.090233 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:35.090205    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls\") pod \"maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:35.272722 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:35.272681    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:35.411679 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:35.411654    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"]
Aug 04 09:41:35.413526 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:41:35.413496    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c28479_f151_4bbd_bc85_1653f5fc8819.slice/crio-c807d80899e7bdf6eba8706972644a239177b65e8fb6635b3e8329754dd78f30 WatchSource:0}: Error finding container c807d80899e7bdf6eba8706972644a239177b65e8fb6635b3e8329754dd78f30: Status 404 returned error can't find the container with id c807d80899e7bdf6eba8706972644a239177b65e8fb6635b3e8329754dd78f30
Aug 04 09:41:36.152718 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:36.152682    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp" event={"ID":"f7c28479-f151-4bbd-bc85-1653f5fc8819","Type":"ContainerStarted","Data":"b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1"}
Aug 04 09:41:36.152900 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:36.152738    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp" event={"ID":"f7c28479-f151-4bbd-bc85-1653f5fc8819","Type":"ContainerStarted","Data":"c807d80899e7bdf6eba8706972644a239177b65e8fb6635b3e8329754dd78f30"}
Aug 04 09:41:36.152900 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:36.152778    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:41:36.170777 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:36.170722    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp" podStartSLOduration=1.83264023 podStartE2EDuration="2.170704759s" totalImagesPullingTime="338.064529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:36.169852583 +0000 UTC m=+2045.915258995" watchObservedRunningTime="2026-08-04 09:41:36.170704759 +0000 UTC m=+2045.916111171"
Aug 04 09:41:42.164395 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:41:42.164362    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:42:16.088247 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.088211    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"]
Aug 04 09:42:16.088867 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.088485    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp" podUID="f7c28479-f151-4bbd-bc85-1653f5fc8819" containerName="maas-api" containerID="cri-o://b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1" gracePeriod=30
Aug 04 09:42:16.338242 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.338218    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:42:16.339738 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.339680    2554 generic.go:356] "Generic (PLEG): container finished" podID="f7c28479-f151-4bbd-bc85-1653f5fc8819" containerID="b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1" exitCode=0
Aug 04 09:42:16.339738 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.339721    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"
Aug 04 09:42:16.339880 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.339761    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp" event={"ID":"f7c28479-f151-4bbd-bc85-1653f5fc8819","Type":"ContainerDied","Data":"b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1"}
Aug 04 09:42:16.339880 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.339817    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp" event={"ID":"f7c28479-f151-4bbd-bc85-1653f5fc8819","Type":"ContainerDied","Data":"c807d80899e7bdf6eba8706972644a239177b65e8fb6635b3e8329754dd78f30"}
Aug 04 09:42:16.339880 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.339847    2554 scope.go:117] "RemoveContainer" containerID="b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1"
Aug 04 09:42:16.348079 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.348060    2554 scope.go:117] "RemoveContainer" containerID="b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1"
Aug 04 09:42:16.348347 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:42:16.348328    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1\": container with ID starting with b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1 not found: ID does not exist" containerID="b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1"
Aug 04 09:42:16.348416 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.348359    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1"} err="failed to get container status \"b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1\": rpc error: code = NotFound desc = could not find container \"b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1\": container with ID starting with b2c55f61764738d715ffb9d3027effb6dd4e5968e72c7d72b58738e9a0ae9fb1 not found: ID does not exist"
Aug 04 09:42:16.433195 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.433164    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c28479-f151-4bbd-bc85-1653f5fc8819-openshift-service-ca\") pod \"f7c28479-f151-4bbd-bc85-1653f5fc8819\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") "
Aug 04 09:42:16.433382 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.433277    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjzhd\" (UniqueName: \"kubernetes.io/projected/f7c28479-f151-4bbd-bc85-1653f5fc8819-kube-api-access-tjzhd\") pod \"f7c28479-f151-4bbd-bc85-1653f5fc8819\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") "
Aug 04 09:42:16.433382 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.433333    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls\") pod \"f7c28479-f151-4bbd-bc85-1653f5fc8819\" (UID: \"f7c28479-f151-4bbd-bc85-1653f5fc8819\") "
Aug 04 09:42:16.433596 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.433569    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7c28479-f151-4bbd-bc85-1653f5fc8819-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f7c28479-f151-4bbd-bc85-1653f5fc8819" (UID: "f7c28479-f151-4bbd-bc85-1653f5fc8819"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:42:16.435511 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.435477    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c28479-f151-4bbd-bc85-1653f5fc8819-kube-api-access-tjzhd" (OuterVolumeSpecName: "kube-api-access-tjzhd") pod "f7c28479-f151-4bbd-bc85-1653f5fc8819" (UID: "f7c28479-f151-4bbd-bc85-1653f5fc8819"). InnerVolumeSpecName "kube-api-access-tjzhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:42:16.435612 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.435570    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f7c28479-f151-4bbd-bc85-1653f5fc8819" (UID: "f7c28479-f151-4bbd-bc85-1653f5fc8819"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:42:16.534850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.534820    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c28479-f151-4bbd-bc85-1653f5fc8819-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:42:16.534850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.534843    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjzhd\" (UniqueName: \"kubernetes.io/projected/f7c28479-f151-4bbd-bc85-1653f5fc8819-kube-api-access-tjzhd\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:42:16.534850 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.534853    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7c28479-f151-4bbd-bc85-1653f5fc8819-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:42:16.661647 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.661618    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"]
Aug 04 09:42:16.668234 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.668207    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea2eafd7-795d794c49-mxbkp"]
Aug 04 09:42:16.782927 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:16.782895    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7c28479-f151-4bbd-bc85-1653f5fc8819" path="/var/lib/kubelet/pods/f7c28479-f151-4bbd-bc85-1653f5fc8819/volumes"
Aug 04 09:42:30.855719 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:30.855686    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:42:30.858176 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:30.856707    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:42:30.863103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:30.863084    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:42:30.864085 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:42:30.864065    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:43:04.096834 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.096796    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"]
Aug 04 09:43:04.097341 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.097018    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv" podUID="7524b774-7f90-4cb4-b827-92511e4d06c6" containerName="manager" containerID="cri-o://c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5" gracePeriod=10
Aug 04 09:43:04.351147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.351086    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:43:04.420772 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.420738    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5g8d\" (UniqueName: \"kubernetes.io/projected/7524b774-7f90-4cb4-b827-92511e4d06c6-kube-api-access-c5g8d\") pod \"7524b774-7f90-4cb4-b827-92511e4d06c6\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") "
Aug 04 09:43:04.420971 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.420817    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7524b774-7f90-4cb4-b827-92511e4d06c6-extensions-socket-volume\") pod \"7524b774-7f90-4cb4-b827-92511e4d06c6\" (UID: \"7524b774-7f90-4cb4-b827-92511e4d06c6\") "
Aug 04 09:43:04.421199 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.421173    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7524b774-7f90-4cb4-b827-92511e4d06c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7524b774-7f90-4cb4-b827-92511e4d06c6" (UID: "7524b774-7f90-4cb4-b827-92511e4d06c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:43:04.423080 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.423053    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7524b774-7f90-4cb4-b827-92511e4d06c6-kube-api-access-c5g8d" (OuterVolumeSpecName: "kube-api-access-c5g8d") pod "7524b774-7f90-4cb4-b827-92511e4d06c6" (UID: "7524b774-7f90-4cb4-b827-92511e4d06c6"). InnerVolumeSpecName "kube-api-access-c5g8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:43:04.522037 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.522003    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5g8d\" (UniqueName: \"kubernetes.io/projected/7524b774-7f90-4cb4-b827-92511e4d06c6-kube-api-access-c5g8d\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:43:04.522037 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.522036    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7524b774-7f90-4cb4-b827-92511e4d06c6-extensions-socket-volume\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:43:04.562375 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.562336    2554 generic.go:356] "Generic (PLEG): container finished" podID="7524b774-7f90-4cb4-b827-92511e4d06c6" containerID="c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5" exitCode=0
Aug 04 09:43:04.562539 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.562382    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv" event={"ID":"7524b774-7f90-4cb4-b827-92511e4d06c6","Type":"ContainerDied","Data":"c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5"}
Aug 04 09:43:04.562539 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.562426    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv" event={"ID":"7524b774-7f90-4cb4-b827-92511e4d06c6","Type":"ContainerDied","Data":"8a31bb405c33337deaecf05602b96be23408feaceeb2630920106398133ada55"}
Aug 04 09:43:04.562539 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.562389    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"
Aug 04 09:43:04.562539 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.562450    2554 scope.go:117] "RemoveContainer" containerID="c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5"
Aug 04 09:43:04.573632 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.573610    2554 scope.go:117] "RemoveContainer" containerID="c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5"
Aug 04 09:43:04.574005 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:43:04.573980    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5\": container with ID starting with c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5 not found: ID does not exist" containerID="c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5"
Aug 04 09:43:04.574052 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.574017    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5"} err="failed to get container status \"c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5\": rpc error: code = NotFound desc = could not find container \"c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5\": container with ID starting with c3c9f20a483c030c1968a2dc635f08e6c552367ea19872f5169969539cfaf6d5 not found: ID does not exist"
Aug 04 09:43:04.584331 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.584308    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"]
Aug 04 09:43:04.588604 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.588583    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-h9pzv"]
Aug 04 09:43:04.780920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:43:04.780844    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7524b774-7f90-4cb4-b827-92511e4d06c6" path="/var/lib/kubelet/pods/7524b774-7f90-4cb4-b827-92511e4d06c6/volumes"
Aug 04 09:44:19.787578 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.787537    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"]
Aug 04 09:44:19.788174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.788025    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7524b774-7f90-4cb4-b827-92511e4d06c6" containerName="manager"
Aug 04 09:44:19.788174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.788043    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7524b774-7f90-4cb4-b827-92511e4d06c6" containerName="manager"
Aug 04 09:44:19.788174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.788079    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c28479-f151-4bbd-bc85-1653f5fc8819" containerName="maas-api"
Aug 04 09:44:19.788174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.788087    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c28479-f151-4bbd-bc85-1653f5fc8819" containerName="maas-api"
Aug 04 09:44:19.788174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.788161    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c28479-f151-4bbd-bc85-1653f5fc8819" containerName="maas-api"
Aug 04 09:44:19.788174 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.788176    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7524b774-7f90-4cb4-b827-92511e4d06c6" containerName="manager"
Aug 04 09:44:19.791132 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.791113    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:19.793832 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.793813    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9rh2j\""
Aug 04 09:44:19.802320 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.802291    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"]
Aug 04 09:44:19.953237 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.953198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bf63b74-5384-42dc-abbb-32f73ef9ac78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z6w84\" (UID: \"0bf63b74-5384-42dc-abbb-32f73ef9ac78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:19.953237 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:19.953240    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbtf\" (UniqueName: \"kubernetes.io/projected/0bf63b74-5384-42dc-abbb-32f73ef9ac78-kube-api-access-4xbtf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z6w84\" (UID: \"0bf63b74-5384-42dc-abbb-32f73ef9ac78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:20.053854 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.053773    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bf63b74-5384-42dc-abbb-32f73ef9ac78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z6w84\" (UID: \"0bf63b74-5384-42dc-abbb-32f73ef9ac78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:20.053854 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.053812    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbtf\" (UniqueName: \"kubernetes.io/projected/0bf63b74-5384-42dc-abbb-32f73ef9ac78-kube-api-access-4xbtf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z6w84\" (UID: \"0bf63b74-5384-42dc-abbb-32f73ef9ac78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:20.054144 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.054124    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bf63b74-5384-42dc-abbb-32f73ef9ac78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z6w84\" (UID: \"0bf63b74-5384-42dc-abbb-32f73ef9ac78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:20.062960 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.062938    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbtf\" (UniqueName: \"kubernetes.io/projected/0bf63b74-5384-42dc-abbb-32f73ef9ac78-kube-api-access-4xbtf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z6w84\" (UID: \"0bf63b74-5384-42dc-abbb-32f73ef9ac78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:20.102597 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.102572    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:20.240964 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.240940    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"]
Aug 04 09:44:20.242594 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:44:20.242566    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf63b74_5384_42dc_abbb_32f73ef9ac78.slice/crio-af038ccc89a86c777709a9743014e3a0b473a41db6f9770cc16d37f7878f5991 WatchSource:0}: Error finding container af038ccc89a86c777709a9743014e3a0b473a41db6f9770cc16d37f7878f5991: Status 404 returned error can't find the container with id af038ccc89a86c777709a9743014e3a0b473a41db6f9770cc16d37f7878f5991
Aug 04 09:44:20.903275 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.903237    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84" event={"ID":"0bf63b74-5384-42dc-abbb-32f73ef9ac78","Type":"ContainerStarted","Data":"bb9c052c30e61c913bed7ecf8db06f0e7f444976783bda2ec8f0a488b676c6dd"}
Aug 04 09:44:20.903785 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.903293    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84" event={"ID":"0bf63b74-5384-42dc-abbb-32f73ef9ac78","Type":"ContainerStarted","Data":"af038ccc89a86c777709a9743014e3a0b473a41db6f9770cc16d37f7878f5991"}
Aug 04 09:44:20.903785 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.903345    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:20.926296 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:20.926253    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84" podStartSLOduration=1.926238222 podStartE2EDuration="1.926238222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:44:20.92411342 +0000 UTC m=+2210.669519833" watchObservedRunningTime="2026-08-04 09:44:20.926238222 +0000 UTC m=+2210.671644632"
Aug 04 09:44:31.912626 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:31.912591    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z6w84"
Aug 04 09:44:43.257953 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.257921    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"]
Aug 04 09:44:43.261281 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.261264    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.264120 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.264100    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-18d97d1d-serving-cert\""
Aug 04 09:44:43.264433 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.264418    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:44:43.287352 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.287328    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"]
Aug 04 09:44:43.453443 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.453404    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.453646 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.453447    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d696351-525c-48dd-8482-fab6c25fcc43-openshift-service-ca\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.453646 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.453581    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kslxc\" (UniqueName: \"kubernetes.io/projected/1d696351-525c-48dd-8482-fab6c25fcc43-kube-api-access-kslxc\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.554858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.554769    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kslxc\" (UniqueName: \"kubernetes.io/projected/1d696351-525c-48dd-8482-fab6c25fcc43-kube-api-access-kslxc\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.554858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.554840    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.554858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.554856    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d696351-525c-48dd-8482-fab6c25fcc43-openshift-service-ca\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.555124 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:44:43.554947    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-serving-cert: secret "maas-api-e2e-mt-18d97d1d-serving-cert" not found
Aug 04 09:44:43.555124 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:44:43.555026    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls podName:1d696351-525c-48dd-8482-fab6c25fcc43 nodeName:}" failed. No retries permitted until 2026-08-04 09:44:44.055006308 +0000 UTC m=+2233.800412711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls") pod "maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4" (UID: "1d696351-525c-48dd-8482-fab6c25fcc43") : secret "maas-api-e2e-mt-18d97d1d-serving-cert" not found
Aug 04 09:44:43.555424 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.555407    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d696351-525c-48dd-8482-fab6c25fcc43-openshift-service-ca\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:43.565291 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:43.565265    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kslxc\" (UniqueName: \"kubernetes.io/projected/1d696351-525c-48dd-8482-fab6c25fcc43-kube-api-access-kslxc\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:44.058764 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:44.058727    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:44.061359 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:44.061333    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls\") pod \"maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:44.171679 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:44.171649    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:44.311164 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:44.311139    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"]
Aug 04 09:44:44.313042 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:44:44.313005    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d696351_525c_48dd_8482_fab6c25fcc43.slice/crio-28fd480028db17863612f433643466ebfed7d522a9786187b7ca57e3d5aec94f WatchSource:0}: Error finding container 28fd480028db17863612f433643466ebfed7d522a9786187b7ca57e3d5aec94f: Status 404 returned error can't find the container with id 28fd480028db17863612f433643466ebfed7d522a9786187b7ca57e3d5aec94f
Aug 04 09:44:44.314751 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:44.314732    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 09:44:45.022090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:45.022006    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4" event={"ID":"1d696351-525c-48dd-8482-fab6c25fcc43","Type":"ContainerStarted","Data":"9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9"}
Aug 04 09:44:45.022090 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:45.022064    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4" event={"ID":"1d696351-525c-48dd-8482-fab6c25fcc43","Type":"ContainerStarted","Data":"28fd480028db17863612f433643466ebfed7d522a9786187b7ca57e3d5aec94f"}
Aug 04 09:44:45.022286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:45.022139    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:44:45.043678 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:45.043629    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4" podStartSLOduration=1.652011844 podStartE2EDuration="2.043614825s" totalImagesPullingTime="391.602981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:44:45.041636395 +0000 UTC m=+2234.787042807" watchObservedRunningTime="2026-08-04 09:44:45.043614825 +0000 UTC m=+2234.789021237"
Aug 04 09:44:51.032277 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:44:51.032249    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:45:30.956674 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:45:30.956644    2554 scope.go:117] "RemoveContainer" containerID="8ce7d80eda9a2bc822445a0e12d08687b456d5197bc3bb77797c0707b19254bb"
Aug 04 09:46:07.536201 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.536151    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"]
Aug 04 09:46:07.536802 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.536424    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4" podUID="1d696351-525c-48dd-8482-fab6c25fcc43" containerName="maas-api" containerID="cri-o://9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9" gracePeriod=30
Aug 04 09:46:07.793198 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.793141    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:46:07.847837 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.847803    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d696351-525c-48dd-8482-fab6c25fcc43-openshift-service-ca\") pod \"1d696351-525c-48dd-8482-fab6c25fcc43\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") "
Aug 04 09:46:07.847837 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.847840    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls\") pod \"1d696351-525c-48dd-8482-fab6c25fcc43\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") "
Aug 04 09:46:07.848040 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.847858    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kslxc\" (UniqueName: \"kubernetes.io/projected/1d696351-525c-48dd-8482-fab6c25fcc43-kube-api-access-kslxc\") pod \"1d696351-525c-48dd-8482-fab6c25fcc43\" (UID: \"1d696351-525c-48dd-8482-fab6c25fcc43\") "
Aug 04 09:46:07.848295 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.848265    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d696351-525c-48dd-8482-fab6c25fcc43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1d696351-525c-48dd-8482-fab6c25fcc43" (UID: "1d696351-525c-48dd-8482-fab6c25fcc43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:46:07.850317 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.850283    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1d696351-525c-48dd-8482-fab6c25fcc43" (UID: "1d696351-525c-48dd-8482-fab6c25fcc43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:46:07.850317 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.850293    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d696351-525c-48dd-8482-fab6c25fcc43-kube-api-access-kslxc" (OuterVolumeSpecName: "kube-api-access-kslxc") pod "1d696351-525c-48dd-8482-fab6c25fcc43" (UID: "1d696351-525c-48dd-8482-fab6c25fcc43"). InnerVolumeSpecName "kube-api-access-kslxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:46:07.949415 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.949372    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d696351-525c-48dd-8482-fab6c25fcc43-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:46:07.949415 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.949406    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d696351-525c-48dd-8482-fab6c25fcc43-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:46:07.949415 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:07.949415    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kslxc\" (UniqueName: \"kubernetes.io/projected/1d696351-525c-48dd-8482-fab6c25fcc43-kube-api-access-kslxc\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:46:08.411845 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.411810    2554 generic.go:356] "Generic (PLEG): container finished" podID="1d696351-525c-48dd-8482-fab6c25fcc43" containerID="9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9" exitCode=0
Aug 04 09:46:08.412058 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.411862    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"
Aug 04 09:46:08.412058 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.411864    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4" event={"ID":"1d696351-525c-48dd-8482-fab6c25fcc43","Type":"ContainerDied","Data":"9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9"}
Aug 04 09:46:08.412058 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.412005    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4" event={"ID":"1d696351-525c-48dd-8482-fab6c25fcc43","Type":"ContainerDied","Data":"28fd480028db17863612f433643466ebfed7d522a9786187b7ca57e3d5aec94f"}
Aug 04 09:46:08.412058 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.412044    2554 scope.go:117] "RemoveContainer" containerID="9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9"
Aug 04 09:46:08.421683 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.421660    2554 scope.go:117] "RemoveContainer" containerID="9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9"
Aug 04 09:46:08.421976 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:46:08.421952    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9\": container with ID starting with 9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9 not found: ID does not exist" containerID="9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9"
Aug 04 09:46:08.422047 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.421991    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9"} err="failed to get container status \"9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9\": rpc error: code = NotFound desc = could not find container \"9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9\": container with ID starting with 9dd970cf5e805648932a2c8935b091cd97e27bd4b76309c59e1f433c3807a9f9 not found: ID does not exist"
Aug 04 09:46:08.437033 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.437001    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"]
Aug 04 09:46:08.445187 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.445164    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18d97d1d-69f56584d4-mhtv4"]
Aug 04 09:46:08.781034 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:46:08.780955    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d696351-525c-48dd-8482-fab6c25fcc43" path="/var/lib/kubelet/pods/1d696351-525c-48dd-8482-fab6c25fcc43/volumes"
Aug 04 09:47:30.883265 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:47:30.883127    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:47:30.886474 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:47:30.886357    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:47:30.891422 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:47:30.891397    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:47:30.894344 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:47:30.894325    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:48:12.291055 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.291015    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"]
Aug 04 09:48:12.291672 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.291570    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d696351-525c-48dd-8482-fab6c25fcc43" containerName="maas-api"
Aug 04 09:48:12.291672 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.291591    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d696351-525c-48dd-8482-fab6c25fcc43" containerName="maas-api"
Aug 04 09:48:12.291799 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.291681    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d696351-525c-48dd-8482-fab6c25fcc43" containerName="maas-api"
Aug 04 09:48:12.295194 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.295172    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.298253 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.298232    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4d301b-serving-cert\""
Aug 04 09:48:12.298369 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.298236    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:48:12.305624 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.305586    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"]
Aug 04 09:48:12.431775 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.431746    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2kzm\" (UniqueName: \"kubernetes.io/projected/962e8b49-2d56-4846-a6ab-c73e0464d48b-kube-api-access-b2kzm\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.431927 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.431790    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/962e8b49-2d56-4846-a6ab-c73e0464d48b-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.431927 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.431820    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/962e8b49-2d56-4846-a6ab-c73e0464d48b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.532392 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.532366    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2kzm\" (UniqueName: \"kubernetes.io/projected/962e8b49-2d56-4846-a6ab-c73e0464d48b-kube-api-access-b2kzm\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.532561 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.532413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/962e8b49-2d56-4846-a6ab-c73e0464d48b-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.532561 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.532464    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/962e8b49-2d56-4846-a6ab-c73e0464d48b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.533081 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.533062    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/962e8b49-2d56-4846-a6ab-c73e0464d48b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.534982 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.534950    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/962e8b49-2d56-4846-a6ab-c73e0464d48b-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.544820 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.544758    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2kzm\" (UniqueName: \"kubernetes.io/projected/962e8b49-2d56-4846-a6ab-c73e0464d48b-kube-api-access-b2kzm\") pod \"maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.606062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.606030    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:12.756062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.756032    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"]
Aug 04 09:48:12.998286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:12.998252    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t" event={"ID":"962e8b49-2d56-4846-a6ab-c73e0464d48b","Type":"ContainerStarted","Data":"a7d42b6016b4e3341f88ffe5aa77ed10969adcd8a5ce94574b24110524616bb3"}
Aug 04 09:48:14.004525 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:14.004486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t" event={"ID":"962e8b49-2d56-4846-a6ab-c73e0464d48b","Type":"ContainerStarted","Data":"8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838"}
Aug 04 09:48:14.004961 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:14.004618    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:14.041818 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:14.041773    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t" podStartSLOduration=1.5386856949999999 podStartE2EDuration="2.041759234s" totalImagesPullingTime="503.073539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:48:14.041566664 +0000 UTC m=+2443.786973074" watchObservedRunningTime="2026-08-04 09:48:14.041759234 +0000 UTC m=+2443.787165645"
Aug 04 09:48:20.016407 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:20.016379    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:48:41.392602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.392567    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"]
Aug 04 09:48:41.396492 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.396467    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.399206 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.399181    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-406b0d-serving-cert\""
Aug 04 09:48:41.409207 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.409185    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"]
Aug 04 09:48:41.470093 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.470064    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62addac9-420a-4cbe-a0be-8db1d8803a8e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.470229 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.470097    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv5w8\" (UniqueName: \"kubernetes.io/projected/62addac9-420a-4cbe-a0be-8db1d8803a8e-kube-api-access-mv5w8\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.470229 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.470170    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62addac9-420a-4cbe-a0be-8db1d8803a8e-maas-api-tls\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.571523 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.571492    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62addac9-420a-4cbe-a0be-8db1d8803a8e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.571656 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.571524    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w8\" (UniqueName: \"kubernetes.io/projected/62addac9-420a-4cbe-a0be-8db1d8803a8e-kube-api-access-mv5w8\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.571656 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.571587    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62addac9-420a-4cbe-a0be-8db1d8803a8e-maas-api-tls\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.572839 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.572811    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62addac9-420a-4cbe-a0be-8db1d8803a8e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.575044 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.575020    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62addac9-420a-4cbe-a0be-8db1d8803a8e-maas-api-tls\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.582261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.582236    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv5w8\" (UniqueName: \"kubernetes.io/projected/62addac9-420a-4cbe-a0be-8db1d8803a8e-kube-api-access-mv5w8\") pod \"maas-api-e2e-inf-b-406b0d-7787677767-7w55p\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.707977 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.707888    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:41.851148 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:41.851120    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"]
Aug 04 09:48:41.852954 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:48:41.852928    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62addac9_420a_4cbe_a0be_8db1d8803a8e.slice/crio-7c9a12e8a18cf96ff2b5ed6fe6e785d631314922167b5d58bf68ab07da30a282 WatchSource:0}: Error finding container 7c9a12e8a18cf96ff2b5ed6fe6e785d631314922167b5d58bf68ab07da30a282: Status 404 returned error can't find the container with id 7c9a12e8a18cf96ff2b5ed6fe6e785d631314922167b5d58bf68ab07da30a282
Aug 04 09:48:42.131055 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:42.131018    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p" event={"ID":"62addac9-420a-4cbe-a0be-8db1d8803a8e","Type":"ContainerStarted","Data":"7c9a12e8a18cf96ff2b5ed6fe6e785d631314922167b5d58bf68ab07da30a282"}
Aug 04 09:48:43.137198 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:43.137159    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p" event={"ID":"62addac9-420a-4cbe-a0be-8db1d8803a8e","Type":"ContainerStarted","Data":"19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc"}
Aug 04 09:48:43.137714 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:43.137279    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:48:43.165139 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:43.165075    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p" podStartSLOduration=1.7959517379999999 podStartE2EDuration="2.165057753s" totalImagesPullingTime="369.106015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:48:43.16484763 +0000 UTC m=+2472.910254054" watchObservedRunningTime="2026-08-04 09:48:43.165057753 +0000 UTC m=+2472.910464164"
Aug 04 09:48:49.147074 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:48:49.147041    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:49:24.307007 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.306919    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"]
Aug 04 09:49:24.310849 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.310832    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.314920 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.314898    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4d301b\"/\"default-dockercfg-4xczg\""
Aug 04 09:49:24.315929 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.315910    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4d301b\"/\"test-model-4d301b-kserve-self-signed-certs\""
Aug 04 09:49:24.316869 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.316852    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4d301b\"/\"openshift-service-ca.crt\""
Aug 04 09:49:24.316977 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.316886    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4d301b\"/\"kube-root-ca.crt\""
Aug 04 09:49:24.335176 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.335143    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-model-cache\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.335176 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.335176    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8slfn\" (UniqueName: \"kubernetes.io/projected/7068ebc0-471b-4a4e-bac3-666f6fb83507-kube-api-access-8slfn\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.335360 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.335238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-tmp-dir\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.335360 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.335283    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-dshm\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.335360 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.335313    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7068ebc0-471b-4a4e-bac3-666f6fb83507-tls-certs\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.335493 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.335386    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-home\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.355669 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.355647    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"]
Aug 04 09:49:24.436131 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436100    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-home\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436169    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-model-cache\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436198    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8slfn\" (UniqueName: \"kubernetes.io/projected/7068ebc0-471b-4a4e-bac3-666f6fb83507-kube-api-access-8slfn\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436264    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-tmp-dir\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436301    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-dshm\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436570 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436333    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7068ebc0-471b-4a4e-bac3-666f6fb83507-tls-certs\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436636 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436615    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-home\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436694 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436676    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-model-cache\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.436740 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.436691    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-tmp-dir\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.438696 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.438678    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-dshm\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.439071 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.439051    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7068ebc0-471b-4a4e-bac3-666f6fb83507-tls-certs\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.451406 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.451376    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8slfn\" (UniqueName: \"kubernetes.io/projected/7068ebc0-471b-4a4e-bac3-666f6fb83507-kube-api-access-8slfn\") pod \"test-model-4d301b-kserve-7f5c8ffc9c-sq4f4\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") " pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.621412 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.621373    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:24.766401 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:24.766374    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"]
Aug 04 09:49:24.768925 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:49:24.768898    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7068ebc0_471b_4a4e_bac3_666f6fb83507.slice/crio-2b954cfa212ba53c8705ac9d8da5b38712e0b79f8c4e8fff071cc44a144206f3 WatchSource:0}: Error finding container 2b954cfa212ba53c8705ac9d8da5b38712e0b79f8c4e8fff071cc44a144206f3: Status 404 returned error can't find the container with id 2b954cfa212ba53c8705ac9d8da5b38712e0b79f8c4e8fff071cc44a144206f3
Aug 04 09:49:25.335417 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:25.335380    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4" event={"ID":"7068ebc0-471b-4a4e-bac3-666f6fb83507","Type":"ContainerStarted","Data":"2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47"}
Aug 04 09:49:25.335417 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:25.335423    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4" event={"ID":"7068ebc0-471b-4a4e-bac3-666f6fb83507","Type":"ContainerStarted","Data":"2b954cfa212ba53c8705ac9d8da5b38712e0b79f8c4e8fff071cc44a144206f3"}
Aug 04 09:49:25.360239 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:25.360191    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4" podStartSLOduration=1.360176777 podStartE2EDuration="1.360176777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:49:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:49:25.359507461 +0000 UTC m=+2515.104913872" watchObservedRunningTime="2026-08-04 09:49:25.360176777 +0000 UTC m=+2515.105583187"
Aug 04 09:49:34.621947 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:34.621914    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:34.622339 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:34.621968    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:34.634711 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:34.634686    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:49:35.392499 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:49:35.392440    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:50:30.356319 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:30.356287    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"]
Aug 04 09:50:35.896415 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:35.896383    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"]
Aug 04 09:50:35.896909 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:35.896632    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t" podUID="962e8b49-2d56-4846-a6ab-c73e0464d48b" containerName="maas-api" containerID="cri-o://8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838" gracePeriod=30
Aug 04 09:50:36.155719 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.155657    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:50:36.252142 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.252110    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2kzm\" (UniqueName: \"kubernetes.io/projected/962e8b49-2d56-4846-a6ab-c73e0464d48b-kube-api-access-b2kzm\") pod \"962e8b49-2d56-4846-a6ab-c73e0464d48b\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") "
Aug 04 09:50:36.252292 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.252159    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/962e8b49-2d56-4846-a6ab-c73e0464d48b-openshift-service-ca\") pod \"962e8b49-2d56-4846-a6ab-c73e0464d48b\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") "
Aug 04 09:50:36.252292 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.252195    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/962e8b49-2d56-4846-a6ab-c73e0464d48b-maas-api-tls\") pod \"962e8b49-2d56-4846-a6ab-c73e0464d48b\" (UID: \"962e8b49-2d56-4846-a6ab-c73e0464d48b\") "
Aug 04 09:50:36.252544 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.252523    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/962e8b49-2d56-4846-a6ab-c73e0464d48b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "962e8b49-2d56-4846-a6ab-c73e0464d48b" (UID: "962e8b49-2d56-4846-a6ab-c73e0464d48b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:50:36.254401 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.254376    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/962e8b49-2d56-4846-a6ab-c73e0464d48b-kube-api-access-b2kzm" (OuterVolumeSpecName: "kube-api-access-b2kzm") pod "962e8b49-2d56-4846-a6ab-c73e0464d48b" (UID: "962e8b49-2d56-4846-a6ab-c73e0464d48b"). InnerVolumeSpecName "kube-api-access-b2kzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:50:36.254401 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.254388    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/962e8b49-2d56-4846-a6ab-c73e0464d48b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "962e8b49-2d56-4846-a6ab-c73e0464d48b" (UID: "962e8b49-2d56-4846-a6ab-c73e0464d48b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:50:36.353446 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.353402    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2kzm\" (UniqueName: \"kubernetes.io/projected/962e8b49-2d56-4846-a6ab-c73e0464d48b-kube-api-access-b2kzm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:36.353446 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.353438    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/962e8b49-2d56-4846-a6ab-c73e0464d48b-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:36.353446 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.353481    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/962e8b49-2d56-4846-a6ab-c73e0464d48b-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:36.675305 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.675270    2554 generic.go:356] "Generic (PLEG): container finished" podID="962e8b49-2d56-4846-a6ab-c73e0464d48b" containerID="8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838" exitCode=0
Aug 04 09:50:36.675523 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.675320    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t" event={"ID":"962e8b49-2d56-4846-a6ab-c73e0464d48b","Type":"ContainerDied","Data":"8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838"}
Aug 04 09:50:36.675523 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.675335    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"
Aug 04 09:50:36.675523 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.675362    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t" event={"ID":"962e8b49-2d56-4846-a6ab-c73e0464d48b","Type":"ContainerDied","Data":"a7d42b6016b4e3341f88ffe5aa77ed10969adcd8a5ce94574b24110524616bb3"}
Aug 04 09:50:36.676144 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.675384    2554 scope.go:117] "RemoveContainer" containerID="8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838"
Aug 04 09:50:36.685217 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.685195    2554 scope.go:117] "RemoveContainer" containerID="8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838"
Aug 04 09:50:36.685511 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:50:36.685491    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838\": container with ID starting with 8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838 not found: ID does not exist" containerID="8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838"
Aug 04 09:50:36.685569 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.685521    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838"} err="failed to get container status \"8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838\": rpc error: code = NotFound desc = could not find container \"8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838\": container with ID starting with 8f0b2ad89b47d2fca5463ba5d488698d2d797f8adcf2ec2c7f154394a77b8838 not found: ID does not exist"
Aug 04 09:50:36.707160 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.707136    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"]
Aug 04 09:50:36.723516 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.723495    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d301b-5f6bf47c7b-8gg7t"]
Aug 04 09:50:36.781154 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:36.781128    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="962e8b49-2d56-4846-a6ab-c73e0464d48b" path="/var/lib/kubelet/pods/962e8b49-2d56-4846-a6ab-c73e0464d48b/volumes"
Aug 04 09:50:45.376529 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.376434    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4" podUID="7068ebc0-471b-4a4e-bac3-666f6fb83507" containerName="main" containerID="cri-o://2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47" gracePeriod=45
Aug 04 09:50:45.381309 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.381279    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4" podUID="7068ebc0-471b-4a4e-bac3-666f6fb83507" containerName="main" probeResult="failure" output="Get \"https://10.132.0.45:8000/ready\": dial tcp 10.132.0.45:8000: connect: connection refused"
Aug 04 09:50:45.629419 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.629357    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:50:45.720350 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.720313    2554 generic.go:356] "Generic (PLEG): container finished" podID="7068ebc0-471b-4a4e-bac3-666f6fb83507" containerID="2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47" exitCode=0
Aug 04 09:50:45.720526 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.720355    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"
Aug 04 09:50:45.720526 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.720399    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4" event={"ID":"7068ebc0-471b-4a4e-bac3-666f6fb83507","Type":"ContainerDied","Data":"2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47"}
Aug 04 09:50:45.720526 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.720444    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4" event={"ID":"7068ebc0-471b-4a4e-bac3-666f6fb83507","Type":"ContainerDied","Data":"2b954cfa212ba53c8705ac9d8da5b38712e0b79f8c4e8fff071cc44a144206f3"}
Aug 04 09:50:45.720526 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.720485    2554 scope.go:117] "RemoveContainer" containerID="2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47"
Aug 04 09:50:45.729195 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.729176    2554 scope.go:117] "RemoveContainer" containerID="2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47"
Aug 04 09:50:45.729471 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:50:45.729438    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47\": container with ID starting with 2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47 not found: ID does not exist" containerID="2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47"
Aug 04 09:50:45.729536 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.729482    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47"} err="failed to get container status \"2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47\": rpc error: code = NotFound desc = could not find container \"2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47\": container with ID starting with 2cd8397816aea8901a32ce367af4fc4de2a9c28873b7dc3183340b7b05221d47 not found: ID does not exist"
Aug 04 09:50:45.734127 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734110    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7068ebc0-471b-4a4e-bac3-666f6fb83507-tls-certs\") pod \"7068ebc0-471b-4a4e-bac3-666f6fb83507\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") "
Aug 04 09:50:45.734205 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734139    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-dshm\") pod \"7068ebc0-471b-4a4e-bac3-666f6fb83507\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") "
Aug 04 09:50:45.734205 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734175    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8slfn\" (UniqueName: \"kubernetes.io/projected/7068ebc0-471b-4a4e-bac3-666f6fb83507-kube-api-access-8slfn\") pod \"7068ebc0-471b-4a4e-bac3-666f6fb83507\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") "
Aug 04 09:50:45.734312 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734223    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-tmp-dir\") pod \"7068ebc0-471b-4a4e-bac3-666f6fb83507\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") "
Aug 04 09:50:45.734312 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734274    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-model-cache\") pod \"7068ebc0-471b-4a4e-bac3-666f6fb83507\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") "
Aug 04 09:50:45.734312 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734293    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-home\") pod \"7068ebc0-471b-4a4e-bac3-666f6fb83507\" (UID: \"7068ebc0-471b-4a4e-bac3-666f6fb83507\") "
Aug 04 09:50:45.735076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734580    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-model-cache" (OuterVolumeSpecName: "model-cache") pod "7068ebc0-471b-4a4e-bac3-666f6fb83507" (UID: "7068ebc0-471b-4a4e-bac3-666f6fb83507"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:50:45.735076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734621    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-home" (OuterVolumeSpecName: "home") pod "7068ebc0-471b-4a4e-bac3-666f6fb83507" (UID: "7068ebc0-471b-4a4e-bac3-666f6fb83507"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:50:45.735076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.734639    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7068ebc0-471b-4a4e-bac3-666f6fb83507" (UID: "7068ebc0-471b-4a4e-bac3-666f6fb83507"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:50:45.736405 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.736370    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-dshm" (OuterVolumeSpecName: "dshm") pod "7068ebc0-471b-4a4e-bac3-666f6fb83507" (UID: "7068ebc0-471b-4a4e-bac3-666f6fb83507"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:50:45.736520 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.736480    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7068ebc0-471b-4a4e-bac3-666f6fb83507-kube-api-access-8slfn" (OuterVolumeSpecName: "kube-api-access-8slfn") pod "7068ebc0-471b-4a4e-bac3-666f6fb83507" (UID: "7068ebc0-471b-4a4e-bac3-666f6fb83507"). InnerVolumeSpecName "kube-api-access-8slfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:50:45.736567 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.736517    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7068ebc0-471b-4a4e-bac3-666f6fb83507-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7068ebc0-471b-4a4e-bac3-666f6fb83507" (UID: "7068ebc0-471b-4a4e-bac3-666f6fb83507"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:50:45.835086 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.835060    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7068ebc0-471b-4a4e-bac3-666f6fb83507-tls-certs\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:45.835086 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.835082    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-dshm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:45.835229 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.835092    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8slfn\" (UniqueName: \"kubernetes.io/projected/7068ebc0-471b-4a4e-bac3-666f6fb83507-kube-api-access-8slfn\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:45.835229 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.835120    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-tmp-dir\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:45.835229 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.835130    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-model-cache\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:45.835229 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:45.835138    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7068ebc0-471b-4a4e-bac3-666f6fb83507-home\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:46.044199 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:46.044161    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"]
Aug 04 09:50:46.048182 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:46.048158    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4d301b/test-model-4d301b-kserve-7f5c8ffc9c-sq4f4"]
Aug 04 09:50:46.781189 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:46.781146    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7068ebc0-471b-4a4e-bac3-666f6fb83507" path="/var/lib/kubelet/pods/7068ebc0-471b-4a4e-bac3-666f6fb83507/volumes"
Aug 04 09:50:58.928294 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:58.928258    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"]
Aug 04 09:50:58.928813 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:58.928547    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p" podUID="62addac9-420a-4cbe-a0be-8db1d8803a8e" containerName="maas-api" containerID="cri-o://19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc" gracePeriod=30
Aug 04 09:50:59.178637 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.178581    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:50:59.247820 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.247785    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv5w8\" (UniqueName: \"kubernetes.io/projected/62addac9-420a-4cbe-a0be-8db1d8803a8e-kube-api-access-mv5w8\") pod \"62addac9-420a-4cbe-a0be-8db1d8803a8e\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") "
Aug 04 09:50:59.247994 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.247836    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62addac9-420a-4cbe-a0be-8db1d8803a8e-openshift-service-ca\") pod \"62addac9-420a-4cbe-a0be-8db1d8803a8e\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") "
Aug 04 09:50:59.247994 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.247912    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62addac9-420a-4cbe-a0be-8db1d8803a8e-maas-api-tls\") pod \"62addac9-420a-4cbe-a0be-8db1d8803a8e\" (UID: \"62addac9-420a-4cbe-a0be-8db1d8803a8e\") "
Aug 04 09:50:59.248307 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.248279    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62addac9-420a-4cbe-a0be-8db1d8803a8e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62addac9-420a-4cbe-a0be-8db1d8803a8e" (UID: "62addac9-420a-4cbe-a0be-8db1d8803a8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:50:59.250257 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.250229    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62addac9-420a-4cbe-a0be-8db1d8803a8e-kube-api-access-mv5w8" (OuterVolumeSpecName: "kube-api-access-mv5w8") pod "62addac9-420a-4cbe-a0be-8db1d8803a8e" (UID: "62addac9-420a-4cbe-a0be-8db1d8803a8e"). InnerVolumeSpecName "kube-api-access-mv5w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:50:59.250364 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.250319    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62addac9-420a-4cbe-a0be-8db1d8803a8e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62addac9-420a-4cbe-a0be-8db1d8803a8e" (UID: "62addac9-420a-4cbe-a0be-8db1d8803a8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:50:59.348716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.348685    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv5w8\" (UniqueName: \"kubernetes.io/projected/62addac9-420a-4cbe-a0be-8db1d8803a8e-kube-api-access-mv5w8\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:59.348716 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.348719    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62addac9-420a-4cbe-a0be-8db1d8803a8e-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:59.348881 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.348734    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62addac9-420a-4cbe-a0be-8db1d8803a8e-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:50:59.788165 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.788127    2554 generic.go:356] "Generic (PLEG): container finished" podID="62addac9-420a-4cbe-a0be-8db1d8803a8e" containerID="19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc" exitCode=0
Aug 04 09:50:59.788362 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.788174    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"
Aug 04 09:50:59.788362 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.788177    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p" event={"ID":"62addac9-420a-4cbe-a0be-8db1d8803a8e","Type":"ContainerDied","Data":"19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc"}
Aug 04 09:50:59.788362 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.788231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p" event={"ID":"62addac9-420a-4cbe-a0be-8db1d8803a8e","Type":"ContainerDied","Data":"7c9a12e8a18cf96ff2b5ed6fe6e785d631314922167b5d58bf68ab07da30a282"}
Aug 04 09:50:59.788362 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.788262    2554 scope.go:117] "RemoveContainer" containerID="19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc"
Aug 04 09:50:59.799205 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.799187    2554 scope.go:117] "RemoveContainer" containerID="19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc"
Aug 04 09:50:59.799507 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:50:59.799486    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc\": container with ID starting with 19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc not found: ID does not exist" containerID="19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc"
Aug 04 09:50:59.799566 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.799519    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc"} err="failed to get container status \"19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc\": rpc error: code = NotFound desc = could not find container \"19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc\": container with ID starting with 19fdc0b7f619a4ee93eda7f6ddb414d89efe148906281ffbfd1749a11ad2c3dc not found: ID does not exist"
Aug 04 09:50:59.814747 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.814723    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"]
Aug 04 09:50:59.819521 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:50:59.819493    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p"]
Aug 04 09:51:00.782170 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:00.782135    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62addac9-420a-4cbe-a0be-8db1d8803a8e" path="/var/lib/kubelet/pods/62addac9-420a-4cbe-a0be-8db1d8803a8e/volumes"
Aug 04 09:51:02.142294 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:02.142248    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-406b0d-7787677767-7w55p" podUID="62addac9-420a-4cbe-a0be-8db1d8803a8e" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.44:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Aug 04 09:51:11.395604 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.395571    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"]
Aug 04 09:51:11.396103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396024    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7068ebc0-471b-4a4e-bac3-666f6fb83507" containerName="main"
Aug 04 09:51:11.396103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396041    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7068ebc0-471b-4a4e-bac3-666f6fb83507" containerName="main"
Aug 04 09:51:11.396103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396064    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62addac9-420a-4cbe-a0be-8db1d8803a8e" containerName="maas-api"
Aug 04 09:51:11.396103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396073    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="62addac9-420a-4cbe-a0be-8db1d8803a8e" containerName="maas-api"
Aug 04 09:51:11.396103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396086    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="962e8b49-2d56-4846-a6ab-c73e0464d48b" containerName="maas-api"
Aug 04 09:51:11.396103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396095    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="962e8b49-2d56-4846-a6ab-c73e0464d48b" containerName="maas-api"
Aug 04 09:51:11.396485 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396187    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7068ebc0-471b-4a4e-bac3-666f6fb83507" containerName="main"
Aug 04 09:51:11.396485 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396201    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="962e8b49-2d56-4846-a6ab-c73e0464d48b" containerName="maas-api"
Aug 04 09:51:11.396485 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.396209    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="62addac9-420a-4cbe-a0be-8db1d8803a8e" containerName="maas-api"
Aug 04 09:51:11.399502 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.399479    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.402356 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.402260    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d27a51-serving-cert\""
Aug 04 09:51:11.402356 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.402313    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:51:11.410170 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.410147    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"]
Aug 04 09:51:11.553473 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.553431    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhh9q\" (UniqueName: \"kubernetes.io/projected/490dc796-07c4-4546-ba9f-d87a56608724-kube-api-access-fhh9q\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.553649 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.553569    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490dc796-07c4-4546-ba9f-d87a56608724-maas-api-tls\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.553649 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.553606    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490dc796-07c4-4546-ba9f-d87a56608724-openshift-service-ca\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.654588 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.654508    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490dc796-07c4-4546-ba9f-d87a56608724-maas-api-tls\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.654588 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.654548    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490dc796-07c4-4546-ba9f-d87a56608724-openshift-service-ca\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.654754 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.654606    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhh9q\" (UniqueName: \"kubernetes.io/projected/490dc796-07c4-4546-ba9f-d87a56608724-kube-api-access-fhh9q\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.655282 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.655263    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490dc796-07c4-4546-ba9f-d87a56608724-openshift-service-ca\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.657102 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.657082    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490dc796-07c4-4546-ba9f-d87a56608724-maas-api-tls\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.664911 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.664885    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhh9q\" (UniqueName: \"kubernetes.io/projected/490dc796-07c4-4546-ba9f-d87a56608724-kube-api-access-fhh9q\") pod \"maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.711596 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.711570    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:11.856066 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.856041    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"]
Aug 04 09:51:11.857927 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:51:11.857899    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490dc796_07c4_4546_ba9f_d87a56608724.slice/crio-38e061740f88d5dcc7909bfdc894ee3b4c86f41a53b69b14cfe66c1268bf4db6 WatchSource:0}: Error finding container 38e061740f88d5dcc7909bfdc894ee3b4c86f41a53b69b14cfe66c1268bf4db6: Status 404 returned error can't find the container with id 38e061740f88d5dcc7909bfdc894ee3b4c86f41a53b69b14cfe66c1268bf4db6
Aug 04 09:51:11.859076 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:11.859058    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 09:51:12.851216 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:12.851179    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n" event={"ID":"490dc796-07c4-4546-ba9f-d87a56608724","Type":"ContainerStarted","Data":"868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11"}
Aug 04 09:51:12.851590 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:12.851232    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n" event={"ID":"490dc796-07c4-4546-ba9f-d87a56608724","Type":"ContainerStarted","Data":"38e061740f88d5dcc7909bfdc894ee3b4c86f41a53b69b14cfe66c1268bf4db6"}
Aug 04 09:51:12.851590 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:12.851291    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:12.896964 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:12.896912    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n" podStartSLOduration=1.275191997 podStartE2EDuration="1.896895013s" totalImagesPullingTime="621.703016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:51:12.895507727 +0000 UTC m=+2622.640914139" watchObservedRunningTime="2026-08-04 09:51:12.896895013 +0000 UTC m=+2622.642301424"
Aug 04 09:51:18.861056 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:18.861023    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:51:40.263965 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.263878    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"]
Aug 04 09:51:40.267524 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.267500    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.270924 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.270900    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0018e3-serving-cert\""
Aug 04 09:51:40.279698 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.279674    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"]
Aug 04 09:51:40.399553 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.399510    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wrtd\" (UniqueName: \"kubernetes.io/projected/cc4fdab7-f4ec-424f-8de3-30061b7312d4-kube-api-access-6wrtd\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.399717 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.399573    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc4fdab7-f4ec-424f-8de3-30061b7312d4-maas-api-tls\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.399717 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.399630    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4fdab7-f4ec-424f-8de3-30061b7312d4-openshift-service-ca\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.500290 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.500257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wrtd\" (UniqueName: \"kubernetes.io/projected/cc4fdab7-f4ec-424f-8de3-30061b7312d4-kube-api-access-6wrtd\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.500521 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.500300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc4fdab7-f4ec-424f-8de3-30061b7312d4-maas-api-tls\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.500521 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.500338    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4fdab7-f4ec-424f-8de3-30061b7312d4-openshift-service-ca\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.500949 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.500928    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4fdab7-f4ec-424f-8de3-30061b7312d4-openshift-service-ca\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.502950 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.502926    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc4fdab7-f4ec-424f-8de3-30061b7312d4-maas-api-tls\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.508896 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.508875    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wrtd\" (UniqueName: \"kubernetes.io/projected/cc4fdab7-f4ec-424f-8de3-30061b7312d4-kube-api-access-6wrtd\") pod \"maas-api-e2e-api-b-0018e3-d8466cc75-k27qt\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.578911 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.578867    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:40.723596 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.723567    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"]
Aug 04 09:51:40.725371 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:51:40.725344    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4fdab7_f4ec_424f_8de3_30061b7312d4.slice/crio-10ee49510bf105dde56857833275a939eef609c3c62b8b32fead70f53a2625ea WatchSource:0}: Error finding container 10ee49510bf105dde56857833275a939eef609c3c62b8b32fead70f53a2625ea: Status 404 returned error can't find the container with id 10ee49510bf105dde56857833275a939eef609c3c62b8b32fead70f53a2625ea
Aug 04 09:51:40.992080 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:40.992000    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt" event={"ID":"cc4fdab7-f4ec-424f-8de3-30061b7312d4","Type":"ContainerStarted","Data":"10ee49510bf105dde56857833275a939eef609c3c62b8b32fead70f53a2625ea"}
Aug 04 09:51:41.998166 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:41.998134    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt" event={"ID":"cc4fdab7-f4ec-424f-8de3-30061b7312d4","Type":"ContainerStarted","Data":"e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2"}
Aug 04 09:51:41.998562 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:41.998197    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:51:42.017016 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:42.016973    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt" podStartSLOduration=1.475341388 podStartE2EDuration="2.016959141s" totalImagesPullingTime="541.617753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:51:42.015703564 +0000 UTC m=+2651.761109974" watchObservedRunningTime="2026-08-04 09:51:42.016959141 +0000 UTC m=+2651.762365557"
Aug 04 09:51:48.009065 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:51:48.009035    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:52:07.284297 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.284257    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"]
Aug 04 09:52:07.288864 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.288840    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"
Aug 04 09:52:07.291626 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.291604    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ftr4r\""
Aug 04 09:52:07.295608 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.295576    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"]
Aug 04 09:52:07.429397 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.429363    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7c877c9-c5e0-4faf-9747-5e96053cb35a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m\" (UID: \"c7c877c9-c5e0-4faf-9747-5e96053cb35a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"
Aug 04 09:52:07.530743 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.530713    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7c877c9-c5e0-4faf-9747-5e96053cb35a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m\" (UID: \"c7c877c9-c5e0-4faf-9747-5e96053cb35a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"
Aug 04 09:52:07.531404 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.531383    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7c877c9-c5e0-4faf-9747-5e96053cb35a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m\" (UID: \"c7c877c9-c5e0-4faf-9747-5e96053cb35a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"
Aug 04 09:52:07.601730 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.601700    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"
Aug 04 09:52:07.741392 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:07.741367    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"]
Aug 04 09:52:07.743611 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:52:07.743582    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c877c9_c5e0_4faf_9747_5e96053cb35a.slice/crio-11fd71719dc99d89edc2119e8bcb53c73cdd48c9337e709a296b9a0a3d8e980a WatchSource:0}: Error finding container 11fd71719dc99d89edc2119e8bcb53c73cdd48c9337e709a296b9a0a3d8e980a: Status 404 returned error can't find the container with id 11fd71719dc99d89edc2119e8bcb53c73cdd48c9337e709a296b9a0a3d8e980a
Aug 04 09:52:08.121993 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:08.121963    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m" event={"ID":"c7c877c9-c5e0-4faf-9747-5e96053cb35a","Type":"ContainerStarted","Data":"11fd71719dc99d89edc2119e8bcb53c73cdd48c9337e709a296b9a0a3d8e980a"}
Aug 04 09:52:10.132499 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:10.132405    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m" event={"ID":"c7c877c9-c5e0-4faf-9747-5e96053cb35a","Type":"ContainerStarted","Data":"660b44196fe21641d4227a9c6febfa2fd95bc81f11b8f6e2561b00edeb183751"}
Aug 04 09:52:10.155854 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:10.155807    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m" podStartSLOduration=1.079296846 podStartE2EDuration="3.155791043s" totalImagesPullingTime="2.076494197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:52:10.154093877 +0000 UTC m=+2679.899500289" watchObservedRunningTime="2026-08-04 09:52:10.155791043 +0000 UTC m=+2679.901197453"
Aug 04 09:52:11.138663 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:11.138619    2554 generic.go:356] "Generic (PLEG): container finished" podID="c7c877c9-c5e0-4faf-9747-5e96053cb35a" containerID="660b44196fe21641d4227a9c6febfa2fd95bc81f11b8f6e2561b00edeb183751" exitCode=0
Aug 04 09:52:11.139049 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:11.138674    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m" event={"ID":"c7c877c9-c5e0-4faf-9747-5e96053cb35a","Type":"ContainerDied","Data":"660b44196fe21641d4227a9c6febfa2fd95bc81f11b8f6e2561b00edeb183751"}
Aug 04 09:52:12.281302 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:12.281276    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"
Aug 04 09:52:12.370506 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:12.370473    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7c877c9-c5e0-4faf-9747-5e96053cb35a-maas-api-service-ca\") pod \"c7c877c9-c5e0-4faf-9747-5e96053cb35a\" (UID: \"c7c877c9-c5e0-4faf-9747-5e96053cb35a\") "
Aug 04 09:52:12.370778 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:12.370756    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7c877c9-c5e0-4faf-9747-5e96053cb35a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c7c877c9-c5e0-4faf-9747-5e96053cb35a" (UID: "c7c877c9-c5e0-4faf-9747-5e96053cb35a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:52:12.471046 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:12.470977    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7c877c9-c5e0-4faf-9747-5e96053cb35a-maas-api-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:52:13.150256 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:13.150213    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m" event={"ID":"c7c877c9-c5e0-4faf-9747-5e96053cb35a","Type":"ContainerDied","Data":"11fd71719dc99d89edc2119e8bcb53c73cdd48c9337e709a296b9a0a3d8e980a"}
Aug 04 09:52:13.150256 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:13.150251    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"
Aug 04 09:52:13.150487 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:13.150274    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11fd71719dc99d89edc2119e8bcb53c73cdd48c9337e709a296b9a0a3d8e980a"
Aug 04 09:52:22.889936 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:22.889905    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"]
Aug 04 09:52:23.113671 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.113625    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"]
Aug 04 09:52:23.117015 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.116987    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d27a51-x2t5m"]
Aug 04 09:52:23.199898 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.199811    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n" podUID="490dc796-07c4-4546-ba9f-d87a56608724" containerName="maas-api" containerID="cri-o://868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11" gracePeriod=30
Aug 04 09:52:23.454671 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.454605    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:52:23.559803 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.559762    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490dc796-07c4-4546-ba9f-d87a56608724-openshift-service-ca\") pod \"490dc796-07c4-4546-ba9f-d87a56608724\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") "
Aug 04 09:52:23.559999 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.559860    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhh9q\" (UniqueName: \"kubernetes.io/projected/490dc796-07c4-4546-ba9f-d87a56608724-kube-api-access-fhh9q\") pod \"490dc796-07c4-4546-ba9f-d87a56608724\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") "
Aug 04 09:52:23.559999 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.559897    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490dc796-07c4-4546-ba9f-d87a56608724-maas-api-tls\") pod \"490dc796-07c4-4546-ba9f-d87a56608724\" (UID: \"490dc796-07c4-4546-ba9f-d87a56608724\") "
Aug 04 09:52:23.560183 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.560158    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490dc796-07c4-4546-ba9f-d87a56608724-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "490dc796-07c4-4546-ba9f-d87a56608724" (UID: "490dc796-07c4-4546-ba9f-d87a56608724"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:52:23.560269 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.560242    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490dc796-07c4-4546-ba9f-d87a56608724-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:52:23.562147 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.562117    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/490dc796-07c4-4546-ba9f-d87a56608724-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "490dc796-07c4-4546-ba9f-d87a56608724" (UID: "490dc796-07c4-4546-ba9f-d87a56608724"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:52:23.562224 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.562203    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490dc796-07c4-4546-ba9f-d87a56608724-kube-api-access-fhh9q" (OuterVolumeSpecName: "kube-api-access-fhh9q") pod "490dc796-07c4-4546-ba9f-d87a56608724" (UID: "490dc796-07c4-4546-ba9f-d87a56608724"). InnerVolumeSpecName "kube-api-access-fhh9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:52:23.661579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.661551    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhh9q\" (UniqueName: \"kubernetes.io/projected/490dc796-07c4-4546-ba9f-d87a56608724-kube-api-access-fhh9q\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:52:23.661579 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:23.661577    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490dc796-07c4-4546-ba9f-d87a56608724-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:52:24.205845 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.205813    2554 generic.go:356] "Generic (PLEG): container finished" podID="490dc796-07c4-4546-ba9f-d87a56608724" containerID="868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11" exitCode=0
Aug 04 09:52:24.206286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.205863    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"
Aug 04 09:52:24.206286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.205904    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n" event={"ID":"490dc796-07c4-4546-ba9f-d87a56608724","Type":"ContainerDied","Data":"868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11"}
Aug 04 09:52:24.206286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.205965    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n" event={"ID":"490dc796-07c4-4546-ba9f-d87a56608724","Type":"ContainerDied","Data":"38e061740f88d5dcc7909bfdc894ee3b4c86f41a53b69b14cfe66c1268bf4db6"}
Aug 04 09:52:24.206286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.205988    2554 scope.go:117] "RemoveContainer" containerID="868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11"
Aug 04 09:52:24.215542 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.215523    2554 scope.go:117] "RemoveContainer" containerID="868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11"
Aug 04 09:52:24.215836 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:52:24.215812    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11\": container with ID starting with 868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11 not found: ID does not exist" containerID="868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11"
Aug 04 09:52:24.215904 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.215845    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11"} err="failed to get container status \"868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11\": rpc error: code = NotFound desc = could not find container \"868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11\": container with ID starting with 868d6478ff4cab839fe3d9eeabc49cab06b002b073d476f5e5922af45e14cd11 not found: ID does not exist"
Aug 04 09:52:24.235699 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.235669    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"]
Aug 04 09:52:24.241110 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.241089    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d27a51-dc6566ccc-2xd2n"]
Aug 04 09:52:24.781995 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.781943    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490dc796-07c4-4546-ba9f-d87a56608724" path="/var/lib/kubelet/pods/490dc796-07c4-4546-ba9f-d87a56608724/volumes"
Aug 04 09:52:24.782473 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:24.782429    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7c877c9-c5e0-4faf-9747-5e96053cb35a" path="/var/lib/kubelet/pods/c7c877c9-c5e0-4faf-9747-5e96053cb35a/volumes"
Aug 04 09:52:30.913146 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:30.913037    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:52:30.935428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:30.916009    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:52:30.935428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:30.920621    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:52:30.935428 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:30.923574    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:52:45.714064 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:45.714025    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"]
Aug 04 09:52:45.714602 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:45.714312    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt" podUID="cc4fdab7-f4ec-424f-8de3-30061b7312d4" containerName="maas-api" containerID="cri-o://e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2" gracePeriod=30
Aug 04 09:52:45.992230 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:45.992204    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:52:46.152434 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.152403    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wrtd\" (UniqueName: \"kubernetes.io/projected/cc4fdab7-f4ec-424f-8de3-30061b7312d4-kube-api-access-6wrtd\") pod \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") "
Aug 04 09:52:46.152626 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.152499    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc4fdab7-f4ec-424f-8de3-30061b7312d4-maas-api-tls\") pod \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") "
Aug 04 09:52:46.152626 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.152552    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4fdab7-f4ec-424f-8de3-30061b7312d4-openshift-service-ca\") pod \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\" (UID: \"cc4fdab7-f4ec-424f-8de3-30061b7312d4\") "
Aug 04 09:52:46.152959 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.152932    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4fdab7-f4ec-424f-8de3-30061b7312d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc4fdab7-f4ec-424f-8de3-30061b7312d4" (UID: "cc4fdab7-f4ec-424f-8de3-30061b7312d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 09:52:46.154608 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.154584    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc4fdab7-f4ec-424f-8de3-30061b7312d4-kube-api-access-6wrtd" (OuterVolumeSpecName: "kube-api-access-6wrtd") pod "cc4fdab7-f4ec-424f-8de3-30061b7312d4" (UID: "cc4fdab7-f4ec-424f-8de3-30061b7312d4"). InnerVolumeSpecName "kube-api-access-6wrtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:52:46.154888 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.154865    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4fdab7-f4ec-424f-8de3-30061b7312d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc4fdab7-f4ec-424f-8de3-30061b7312d4" (UID: "cc4fdab7-f4ec-424f-8de3-30061b7312d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:52:46.254156 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.254073    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wrtd\" (UniqueName: \"kubernetes.io/projected/cc4fdab7-f4ec-424f-8de3-30061b7312d4-kube-api-access-6wrtd\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:52:46.254156 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.254101    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc4fdab7-f4ec-424f-8de3-30061b7312d4-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:52:46.254156 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.254110    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4fdab7-f4ec-424f-8de3-30061b7312d4-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:52:46.319144 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.319107    2554 generic.go:356] "Generic (PLEG): container finished" podID="cc4fdab7-f4ec-424f-8de3-30061b7312d4" containerID="e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2" exitCode=0
Aug 04 09:52:46.319306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.319157    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"
Aug 04 09:52:46.319306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.319159    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt" event={"ID":"cc4fdab7-f4ec-424f-8de3-30061b7312d4","Type":"ContainerDied","Data":"e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2"}
Aug 04 09:52:46.319306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.319273    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt" event={"ID":"cc4fdab7-f4ec-424f-8de3-30061b7312d4","Type":"ContainerDied","Data":"10ee49510bf105dde56857833275a939eef609c3c62b8b32fead70f53a2625ea"}
Aug 04 09:52:46.319306 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.319295    2554 scope.go:117] "RemoveContainer" containerID="e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2"
Aug 04 09:52:46.328444 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.328424    2554 scope.go:117] "RemoveContainer" containerID="e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2"
Aug 04 09:52:46.328727 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:52:46.328709    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2\": container with ID starting with e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2 not found: ID does not exist" containerID="e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2"
Aug 04 09:52:46.328776 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.328737    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2"} err="failed to get container status \"e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2\": rpc error: code = NotFound desc = could not find container \"e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2\": container with ID starting with e939dee01007fdc8f00c22461c71cb43feb222d3f01af635c1350daa87c275d2 not found: ID does not exist"
Aug 04 09:52:46.346586 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.346561    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"]
Aug 04 09:52:46.352869 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.352845    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0018e3-d8466cc75-k27qt"]
Aug 04 09:52:46.782334 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:46.782294    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc4fdab7-f4ec-424f-8de3-30061b7312d4" path="/var/lib/kubelet/pods/cc4fdab7-f4ec-424f-8de3-30061b7312d4/volumes"
Aug 04 09:52:57.986632 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.986598    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"]
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.986984    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc4fdab7-f4ec-424f-8de3-30061b7312d4" containerName="maas-api"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.986996    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4fdab7-f4ec-424f-8de3-30061b7312d4" containerName="maas-api"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.987008    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c877c9-c5e0-4faf-9747-5e96053cb35a" containerName="revoke-keys"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.987013    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c877c9-c5e0-4faf-9747-5e96053cb35a" containerName="revoke-keys"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.987025    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490dc796-07c4-4546-ba9f-d87a56608724" containerName="maas-api"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.987031    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="490dc796-07c4-4546-ba9f-d87a56608724" containerName="maas-api"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.987085    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="490dc796-07c4-4546-ba9f-d87a56608724" containerName="maas-api"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.987093    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7c877c9-c5e0-4faf-9747-5e96053cb35a" containerName="revoke-keys"
Aug 04 09:52:57.987122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.987101    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc4fdab7-f4ec-424f-8de3-30061b7312d4" containerName="maas-api"
Aug 04 09:52:57.991572 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.991550    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:57.994529 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.994509    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6qnvf\""
Aug 04 09:52:57.995281 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:57.995255    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-497679-serving-cert\""
Aug 04 09:52:58.003474 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.003435    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"]
Aug 04 09:52:58.155567 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.155537    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c02aba-5e92-4cf7-b190-8e582e1c604a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.155741 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.155624    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.155741 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.155652    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf78x\" (UniqueName: \"kubernetes.io/projected/80c02aba-5e92-4cf7-b190-8e582e1c604a-kube-api-access-tf78x\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.257108 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.257024    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c02aba-5e92-4cf7-b190-8e582e1c604a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.257108 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.257089    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.257284 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.257111    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf78x\" (UniqueName: \"kubernetes.io/projected/80c02aba-5e92-4cf7-b190-8e582e1c604a-kube-api-access-tf78x\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.257284 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:52:58.257235    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-serving-cert: secret "maas-api-e2e-shared-a-497679-serving-cert" not found
Aug 04 09:52:58.257351 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:52:58.257310    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls podName:80c02aba-5e92-4cf7-b190-8e582e1c604a nodeName:}" failed. No retries permitted until 2026-08-04 09:52:58.757289106 +0000 UTC m=+2728.502695495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls") pod "maas-api-e2e-shared-a-497679-576ff695f6-xvh4v" (UID: "80c02aba-5e92-4cf7-b190-8e582e1c604a") : secret "maas-api-e2e-shared-a-497679-serving-cert" not found
Aug 04 09:52:58.257790 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.257772    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c02aba-5e92-4cf7-b190-8e582e1c604a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.267122 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.267098    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf78x\" (UniqueName: \"kubernetes.io/projected/80c02aba-5e92-4cf7-b190-8e582e1c604a-kube-api-access-tf78x\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.761221 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.761184    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.763779 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.763752    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls\") pod \"maas-api-e2e-shared-a-497679-576ff695f6-xvh4v\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:58.901980 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:58.901945    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:52:59.055731 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:59.055703    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"]
Aug 04 09:52:59.057996 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:52:59.057965    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c02aba_5e92_4cf7_b190_8e582e1c604a.slice/crio-698d2767e6491fc761053798e8688d8368a9a85b47cf5e780e44e33a96fd405b WatchSource:0}: Error finding container 698d2767e6491fc761053798e8688d8368a9a85b47cf5e780e44e33a96fd405b: Status 404 returned error can't find the container with id 698d2767e6491fc761053798e8688d8368a9a85b47cf5e780e44e33a96fd405b
Aug 04 09:52:59.388961 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:52:59.388925    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v" event={"ID":"80c02aba-5e92-4cf7-b190-8e582e1c604a","Type":"ContainerStarted","Data":"698d2767e6491fc761053798e8688d8368a9a85b47cf5e780e44e33a96fd405b"}
Aug 04 09:53:00.395519 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:00.395474    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v" event={"ID":"80c02aba-5e92-4cf7-b190-8e582e1c604a","Type":"ContainerStarted","Data":"608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269"}
Aug 04 09:53:00.420319 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:00.420271    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v" podStartSLOduration=3.114721637 podStartE2EDuration="3.420252409s" totalImagesPullingTime="305.530772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:53:00.41837217 +0000 UTC m=+2730.163778580" watchObservedRunningTime="2026-08-04 09:53:00.420252409 +0000 UTC m=+2730.165658821"
Aug 04 09:53:01.400207 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:01.400174    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:53:07.410037 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:07.410004    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 09:53:26.868874 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:26.868834    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"]
Aug 04 09:53:26.873752 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:26.873724    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:26.882938 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:26.882916    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b0bc81-serving-cert\""
Aug 04 09:53:26.903773 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:26.903741    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"]
Aug 04 09:53:26.905086 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:26.905063    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca255be-ccf6-4603-92f5-589e2014bd63-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:26.905210 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:26.905094    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:26.905210 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:26.905137    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkhrq\" (UniqueName: \"kubernetes.io/projected/6ca255be-ccf6-4603-92f5-589e2014bd63-kube-api-access-gkhrq\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.006245 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.006212    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca255be-ccf6-4603-92f5-589e2014bd63-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.006245 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.006247    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.006425 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.006281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkhrq\" (UniqueName: \"kubernetes.io/projected/6ca255be-ccf6-4603-92f5-589e2014bd63-kube-api-access-gkhrq\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.006425 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:53:27.006370    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-serving-cert: secret "maas-api-e2e-shared-b-b0bc81-serving-cert" not found
Aug 04 09:53:27.006542 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:53:27.006483    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls podName:6ca255be-ccf6-4603-92f5-589e2014bd63 nodeName:}" failed. No retries permitted until 2026-08-04 09:53:27.506434722 +0000 UTC m=+2757.251841119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls") pod "maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x" (UID: "6ca255be-ccf6-4603-92f5-589e2014bd63") : secret "maas-api-e2e-shared-b-b0bc81-serving-cert" not found
Aug 04 09:53:27.006944 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.006927    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca255be-ccf6-4603-92f5-589e2014bd63-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.022825 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.022801    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkhrq\" (UniqueName: \"kubernetes.io/projected/6ca255be-ccf6-4603-92f5-589e2014bd63-kube-api-access-gkhrq\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.509879 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.509838    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.512400 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.512365    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.787262 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.787179    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:27.950978 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:27.950952    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"]
Aug 04 09:53:27.952898 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:53:27.952869    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca255be_ccf6_4603_92f5_589e2014bd63.slice/crio-702e29dfd2186725d0dc0388502ba1a0ade1ad9a33e22a05456fbf17218663d0 WatchSource:0}: Error finding container 702e29dfd2186725d0dc0388502ba1a0ade1ad9a33e22a05456fbf17218663d0: Status 404 returned error can't find the container with id 702e29dfd2186725d0dc0388502ba1a0ade1ad9a33e22a05456fbf17218663d0
Aug 04 09:53:28.531665 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:28.531629    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x" event={"ID":"6ca255be-ccf6-4603-92f5-589e2014bd63","Type":"ContainerStarted","Data":"8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10"}
Aug 04 09:53:28.531822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:28.531681    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x" event={"ID":"6ca255be-ccf6-4603-92f5-589e2014bd63","Type":"ContainerStarted","Data":"702e29dfd2186725d0dc0388502ba1a0ade1ad9a33e22a05456fbf17218663d0"}
Aug 04 09:53:28.531822 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:28.531765    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:34.541549 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:34.541513    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 09:53:34.571912 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:53:34.571862    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x" podStartSLOduration=8.232316118 podStartE2EDuration="8.571845858s" totalImagesPullingTime="339.52974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:53:28.585675509 +0000 UTC m=+2758.331081920" watchObservedRunningTime="2026-08-04 09:53:34.571845858 +0000 UTC m=+2764.317252272"
Aug 04 09:54:02.745934 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.745897    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"]
Aug 04 09:54:02.749408 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.749385    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:02.754878 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.754851    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"openshift-service-ca.crt\""
Aug 04 09:54:02.755094 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.754851    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"default-dockercfg-q72m6\""
Aug 04 09:54:02.755178 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.754856    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"auth-test-model-497679-kserve-self-signed-certs\""
Aug 04 09:54:02.755246 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.754873    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"kube-root-ca.crt\""
Aug 04 09:54:02.764554 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.764532    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"]
Aug 04 09:54:02.908006 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.907967    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-tmp-dir\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:02.908219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.908089    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqnjz\" (UniqueName: \"kubernetes.io/projected/d1feaa71-016d-4ef2-90ed-38731b4a124c-kube-api-access-bqnjz\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:02.908219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.908129    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-model-cache\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:02.908219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.908159    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1feaa71-016d-4ef2-90ed-38731b4a124c-tls-certs\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:02.908219 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.908207    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-home\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:02.908429 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:02.908229    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-dshm\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009095 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-tmp-dir\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009095 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009068    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqnjz\" (UniqueName: \"kubernetes.io/projected/d1feaa71-016d-4ef2-90ed-38731b4a124c-kube-api-access-bqnjz\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009095 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009088    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-model-cache\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009375 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009103    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1feaa71-016d-4ef2-90ed-38731b4a124c-tls-certs\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009375 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009131    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-home\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009375 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009172    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-dshm\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009375 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009354    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-tmp-dir\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009650 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009631    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-model-cache\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.009701 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.009634    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-home\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.011646 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.011624    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-dshm\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.011809 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.011789    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1feaa71-016d-4ef2-90ed-38731b4a124c-tls-certs\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.019362 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.019341    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqnjz\" (UniqueName: \"kubernetes.io/projected/d1feaa71-016d-4ef2-90ed-38731b4a124c-kube-api-access-bqnjz\") pod \"auth-test-model-497679-kserve-7cb8464f9f-ghxfp\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") " pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.059507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.059476    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:03.206970 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.206940    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"]
Aug 04 09:54:03.209111 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:54:03.209075    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1feaa71_016d_4ef2_90ed_38731b4a124c.slice/crio-978db24ba0196c964d306fe67557585fdf88a9fca375044d588606ed177319ee WatchSource:0}: Error finding container 978db24ba0196c964d306fe67557585fdf88a9fca375044d588606ed177319ee: Status 404 returned error can't find the container with id 978db24ba0196c964d306fe67557585fdf88a9fca375044d588606ed177319ee
Aug 04 09:54:03.693551 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.693514    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp" event={"ID":"d1feaa71-016d-4ef2-90ed-38731b4a124c","Type":"ContainerStarted","Data":"6380adc0aa9127f8bb064454d58a2676b54647db643ef11bdafbb3e1ec7d04e9"}
Aug 04 09:54:03.693729 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.693559    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp" event={"ID":"d1feaa71-016d-4ef2-90ed-38731b4a124c","Type":"ContainerStarted","Data":"978db24ba0196c964d306fe67557585fdf88a9fca375044d588606ed177319ee"}
Aug 04 09:54:03.721169 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:03.721122    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp" podStartSLOduration=1.721107642 podStartE2EDuration="1.721107642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:54:03.719172042 +0000 UTC m=+2793.464578456" watchObservedRunningTime="2026-08-04 09:54:03.721107642 +0000 UTC m=+2793.466514089"
Aug 04 09:54:13.059995 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:13.059963    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:13.060465 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:13.060019    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:13.072103 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:13.072077    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:13.754129 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:13.754100    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:54:37.759847 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.759814    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"]
Aug 04 09:54:37.763507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.763488    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.767880 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.767858    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b0bc81\"/\"default-dockercfg-jb7w9\""
Aug 04 09:54:37.768015 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.767927    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b0bc81\"/\"auth-test-model-b0bc81-kserve-self-signed-certs\""
Aug 04 09:54:37.768187 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.768170    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b0bc81\"/\"kube-root-ca.crt\""
Aug 04 09:54:37.768277 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.768211    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b0bc81\"/\"openshift-service-ca.crt\""
Aug 04 09:54:37.777943 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.777921    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"]
Aug 04 09:54:37.887659 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.887627    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tmp-dir\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.887858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.887665    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7kzh\" (UniqueName: \"kubernetes.io/projected/1ba96c54-6979-4ecf-baf4-9e5c686a9836-kube-api-access-h7kzh\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.887858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.887702    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-dshm\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.887858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.887810    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-home\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.887858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.887857    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tls-certs\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.888105 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.887900    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-model-cache\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989305 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989263    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-dshm\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989316    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-home\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989350    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tls-certs\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989379    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-model-cache\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989507 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989448    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tmp-dir\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989756 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989514    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7kzh\" (UniqueName: \"kubernetes.io/projected/1ba96c54-6979-4ecf-baf4-9e5c686a9836-kube-api-access-h7kzh\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989870 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989846    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-model-cache\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989927 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989870    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-home\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.989927 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.989900    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tmp-dir\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.991844 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.991824    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-dshm\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.992124 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.992096    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tls-certs\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:37.998820 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:37.998799    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7kzh\" (UniqueName: \"kubernetes.io/projected/1ba96c54-6979-4ecf-baf4-9e5c686a9836-kube-api-access-h7kzh\") pod \"auth-test-model-b0bc81-kserve-6dff95679f-ch7ts\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") " pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:38.072567 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:38.072534    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:38.215696 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:38.215668    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"]
Aug 04 09:54:38.217503 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:54:38.217471    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ba96c54_6979_4ecf_baf4_9e5c686a9836.slice/crio-d04539f26c87db28cbba125b74abb8c44dbd559f744fbe0beafc56b48cd5daf2 WatchSource:0}: Error finding container d04539f26c87db28cbba125b74abb8c44dbd559f744fbe0beafc56b48cd5daf2: Status 404 returned error can't find the container with id d04539f26c87db28cbba125b74abb8c44dbd559f744fbe0beafc56b48cd5daf2
Aug 04 09:54:38.865277 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:38.865238    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts" event={"ID":"1ba96c54-6979-4ecf-baf4-9e5c686a9836","Type":"ContainerStarted","Data":"1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558"}
Aug 04 09:54:38.865706 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:38.865288    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts" event={"ID":"1ba96c54-6979-4ecf-baf4-9e5c686a9836","Type":"ContainerStarted","Data":"d04539f26c87db28cbba125b74abb8c44dbd559f744fbe0beafc56b48cd5daf2"}
Aug 04 09:54:38.893013 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:38.887743    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts" podStartSLOduration=1.887723978 podStartE2EDuration="1.887723978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:54:38.885543793 +0000 UTC m=+2828.630950205" watchObservedRunningTime="2026-08-04 09:54:38.887723978 +0000 UTC m=+2828.633130389"
Aug 04 09:54:48.073432 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:48.073391    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:48.073923 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:48.073446    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:48.086581 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:48.086554    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:54:48.927371 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:54:48.927339    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:57:30.945371 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:30.945261    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:57:30.948563 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:30.948516    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 09:57:30.952791 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:30.952769    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:57:30.955427 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:30.955407    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 09:57:37.603105 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:37.603064    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"]
Aug 04 09:57:38.816108 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:38.816069    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"]
Aug 04 09:57:52.622424 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.622360    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp" podUID="d1feaa71-016d-4ef2-90ed-38731b4a124c" containerName="main" containerID="cri-o://6380adc0aa9127f8bb064454d58a2676b54647db643ef11bdafbb3e1ec7d04e9" gracePeriod=45
Aug 04 09:57:52.829651 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.829605    2554 generic.go:356] "Generic (PLEG): container finished" podID="d1feaa71-016d-4ef2-90ed-38731b4a124c" containerID="6380adc0aa9127f8bb064454d58a2676b54647db643ef11bdafbb3e1ec7d04e9" exitCode=0
Aug 04 09:57:52.829805 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.829678    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp" event={"ID":"d1feaa71-016d-4ef2-90ed-38731b4a124c","Type":"ContainerDied","Data":"6380adc0aa9127f8bb064454d58a2676b54647db643ef11bdafbb3e1ec7d04e9"}
Aug 04 09:57:52.880793 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.880726    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:57:52.949254 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949225    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-dshm\") pod \"d1feaa71-016d-4ef2-90ed-38731b4a124c\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") "
Aug 04 09:57:52.949490 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949276    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-model-cache\") pod \"d1feaa71-016d-4ef2-90ed-38731b4a124c\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") "
Aug 04 09:57:52.949490 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949317    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqnjz\" (UniqueName: \"kubernetes.io/projected/d1feaa71-016d-4ef2-90ed-38731b4a124c-kube-api-access-bqnjz\") pod \"d1feaa71-016d-4ef2-90ed-38731b4a124c\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") "
Aug 04 09:57:52.949490 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949366    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1feaa71-016d-4ef2-90ed-38731b4a124c-tls-certs\") pod \"d1feaa71-016d-4ef2-90ed-38731b4a124c\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") "
Aug 04 09:57:52.949490 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949405    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-tmp-dir\") pod \"d1feaa71-016d-4ef2-90ed-38731b4a124c\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") "
Aug 04 09:57:52.949490 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949440    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-home\") pod \"d1feaa71-016d-4ef2-90ed-38731b4a124c\" (UID: \"d1feaa71-016d-4ef2-90ed-38731b4a124c\") "
Aug 04 09:57:52.949763 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949674    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1feaa71-016d-4ef2-90ed-38731b4a124c" (UID: "d1feaa71-016d-4ef2-90ed-38731b4a124c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:52.949763 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949713    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1feaa71-016d-4ef2-90ed-38731b4a124c" (UID: "d1feaa71-016d-4ef2-90ed-38731b4a124c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:52.949858 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949773    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-model-cache\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:52.949912 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.949888    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-home" (OuterVolumeSpecName: "home") pod "d1feaa71-016d-4ef2-90ed-38731b4a124c" (UID: "d1feaa71-016d-4ef2-90ed-38731b4a124c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:52.951741 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.951720    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-dshm" (OuterVolumeSpecName: "dshm") pod "d1feaa71-016d-4ef2-90ed-38731b4a124c" (UID: "d1feaa71-016d-4ef2-90ed-38731b4a124c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:52.951836 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.951816    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1feaa71-016d-4ef2-90ed-38731b4a124c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1feaa71-016d-4ef2-90ed-38731b4a124c" (UID: "d1feaa71-016d-4ef2-90ed-38731b4a124c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:57:52.951877 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:52.951860    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1feaa71-016d-4ef2-90ed-38731b4a124c-kube-api-access-bqnjz" (OuterVolumeSpecName: "kube-api-access-bqnjz") pod "d1feaa71-016d-4ef2-90ed-38731b4a124c" (UID: "d1feaa71-016d-4ef2-90ed-38731b4a124c"). InnerVolumeSpecName "kube-api-access-bqnjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:57:53.050662 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.050624    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqnjz\" (UniqueName: \"kubernetes.io/projected/d1feaa71-016d-4ef2-90ed-38731b4a124c-kube-api-access-bqnjz\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:53.050662 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.050652    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1feaa71-016d-4ef2-90ed-38731b4a124c-tls-certs\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:53.050662 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.050665    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-tmp-dir\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:53.050662 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.050673    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-home\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:53.050936 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.050681    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1feaa71-016d-4ef2-90ed-38731b4a124c-dshm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:53.836235 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.836195    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts" podUID="1ba96c54-6979-4ecf-baf4-9e5c686a9836" containerName="main" containerID="cri-o://1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558" gracePeriod=45
Aug 04 09:57:53.836991 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.836762    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"
Aug 04 09:57:53.836991 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.836755    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp" event={"ID":"d1feaa71-016d-4ef2-90ed-38731b4a124c","Type":"ContainerDied","Data":"978db24ba0196c964d306fe67557585fdf88a9fca375044d588606ed177319ee"}
Aug 04 09:57:53.836991 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.836903    2554 scope.go:117] "RemoveContainer" containerID="6380adc0aa9127f8bb064454d58a2676b54647db643ef11bdafbb3e1ec7d04e9"
Aug 04 09:57:53.863093 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.863057    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"]
Aug 04 09:57:53.870789 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:53.870762    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-497679/auth-test-model-497679-kserve-7cb8464f9f-ghxfp"]
Aug 04 09:57:54.093957 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.093901    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:57:54.161826 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.161793    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-home\") pod \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") "
Aug 04 09:57:54.162008 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.161871    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tls-certs\") pod \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") "
Aug 04 09:57:54.162008 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.161892    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tmp-dir\") pod \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") "
Aug 04 09:57:54.162008 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.161907    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-dshm\") pod \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") "
Aug 04 09:57:54.162008 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.161923    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-model-cache\") pod \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") "
Aug 04 09:57:54.162008 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.161971    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7kzh\" (UniqueName: \"kubernetes.io/projected/1ba96c54-6979-4ecf-baf4-9e5c686a9836-kube-api-access-h7kzh\") pod \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\" (UID: \"1ba96c54-6979-4ecf-baf4-9e5c686a9836\") "
Aug 04 09:57:54.162281 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.162049    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-home" (OuterVolumeSpecName: "home") pod "1ba96c54-6979-4ecf-baf4-9e5c686a9836" (UID: "1ba96c54-6979-4ecf-baf4-9e5c686a9836"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:54.162281 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.162202    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-home\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:54.162281 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.162195    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ba96c54-6979-4ecf-baf4-9e5c686a9836" (UID: "1ba96c54-6979-4ecf-baf4-9e5c686a9836"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:54.162281 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.162207    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ba96c54-6979-4ecf-baf4-9e5c686a9836" (UID: "1ba96c54-6979-4ecf-baf4-9e5c686a9836"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:54.164342 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.164312    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ba96c54-6979-4ecf-baf4-9e5c686a9836" (UID: "1ba96c54-6979-4ecf-baf4-9e5c686a9836"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 09:57:54.164658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.164639    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-dshm" (OuterVolumeSpecName: "dshm") pod "1ba96c54-6979-4ecf-baf4-9e5c686a9836" (UID: "1ba96c54-6979-4ecf-baf4-9e5c686a9836"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 09:57:54.164731 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.164691    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba96c54-6979-4ecf-baf4-9e5c686a9836-kube-api-access-h7kzh" (OuterVolumeSpecName: "kube-api-access-h7kzh") pod "1ba96c54-6979-4ecf-baf4-9e5c686a9836" (UID: "1ba96c54-6979-4ecf-baf4-9e5c686a9836"). InnerVolumeSpecName "kube-api-access-h7kzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 09:57:54.262989 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.262950    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tls-certs\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:54.262989 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.262985    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-tmp-dir\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:54.262989 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.262993    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-dshm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:54.262989 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.263001    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ba96c54-6979-4ecf-baf4-9e5c686a9836-model-cache\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:54.263267 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.263011    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7kzh\" (UniqueName: \"kubernetes.io/projected/1ba96c54-6979-4ecf-baf4-9e5c686a9836-kube-api-access-h7kzh\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 09:57:54.782927 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.782890    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1feaa71-016d-4ef2-90ed-38731b4a124c" path="/var/lib/kubelet/pods/d1feaa71-016d-4ef2-90ed-38731b4a124c/volumes"
Aug 04 09:57:54.844083 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.844046    2554 generic.go:356] "Generic (PLEG): container finished" podID="1ba96c54-6979-4ecf-baf4-9e5c686a9836" containerID="1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558" exitCode=0
Aug 04 09:57:54.844083 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.844086    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"
Aug 04 09:57:54.844658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.844131    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts" event={"ID":"1ba96c54-6979-4ecf-baf4-9e5c686a9836","Type":"ContainerDied","Data":"1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558"}
Aug 04 09:57:54.844658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.844174    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts" event={"ID":"1ba96c54-6979-4ecf-baf4-9e5c686a9836","Type":"ContainerDied","Data":"d04539f26c87db28cbba125b74abb8c44dbd559f744fbe0beafc56b48cd5daf2"}
Aug 04 09:57:54.844658 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.844192    2554 scope.go:117] "RemoveContainer" containerID="1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558"
Aug 04 09:57:54.853391 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.853372    2554 scope.go:117] "RemoveContainer" containerID="1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558"
Aug 04 09:57:54.853742 ip-10-0-143-202 kubenswrapper[2554]: E0804 09:57:54.853722    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558\": container with ID starting with 1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558 not found: ID does not exist" containerID="1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558"
Aug 04 09:57:54.853810 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.853752    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558"} err="failed to get container status \"1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558\": rpc error: code = NotFound desc = could not find container \"1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558\": container with ID starting with 1b982a10e23c0ce3aa9a099ebebb5f9369c1fa95f84957b0acdd3e4594388558 not found: ID does not exist"
Aug 04 09:57:54.863201 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.863173    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"]
Aug 04 09:57:54.867529 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:54.867505    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b0bc81/auth-test-model-b0bc81-kserve-6dff95679f-ch7ts"]
Aug 04 09:57:56.782317 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:57:56.782279    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba96c54-6979-4ecf-baf4-9e5c686a9836" path="/var/lib/kubelet/pods/1ba96c54-6979-4ecf-baf4-9e5c686a9836/volumes"
Aug 04 09:58:04.998516 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:04.998476    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"]
Aug 04 09:58:04.998900 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:04.998834    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1feaa71-016d-4ef2-90ed-38731b4a124c" containerName="main"
Aug 04 09:58:04.998900 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:04.998845    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1feaa71-016d-4ef2-90ed-38731b4a124c" containerName="main"
Aug 04 09:58:04.998900 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:04.998860    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba96c54-6979-4ecf-baf4-9e5c686a9836" containerName="main"
Aug 04 09:58:04.998900 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:04.998866    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba96c54-6979-4ecf-baf4-9e5c686a9836" containerName="main"
Aug 04 09:58:04.999065 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:04.998934    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba96c54-6979-4ecf-baf4-9e5c686a9836" containerName="main"
Aug 04 09:58:04.999065 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:04.998954    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1feaa71-016d-4ef2-90ed-38731b4a124c" containerName="main"
Aug 04 09:58:05.003102 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.003083    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.006999 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.006976    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"openshift-service-ca.crt\""
Aug 04 09:58:05.007143 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.006981    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"kube-root-ca.crt\""
Aug 04 09:58:05.008231 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.008209    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"sub-test-model-497679-kserve-self-signed-certs\""
Aug 04 09:58:05.008346 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.008243    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"default-dockercfg-q72m6\""
Aug 04 09:58:05.029829 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.029808    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"]
Aug 04 09:58:05.056160 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.056131    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-tmp-dir\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.056286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.056186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-model-cache\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.056286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.056220    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0009936-d6fe-4330-b354-dd7207ce36f8-tls-certs\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.056286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.056237    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-dshm\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.056286 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.056282    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-home\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.056435 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.056320    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b69vc\" (UniqueName: \"kubernetes.io/projected/f0009936-d6fe-4330-b354-dd7207ce36f8-kube-api-access-b69vc\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157021    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-home\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157062 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157069    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b69vc\" (UniqueName: \"kubernetes.io/projected/f0009936-d6fe-4330-b354-dd7207ce36f8-kube-api-access-b69vc\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157291 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157197    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-tmp-dir\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157291 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157277    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-model-cache\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157317    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0009936-d6fe-4330-b354-dd7207ce36f8-tls-certs\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157385 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157340    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-dshm\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157533 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157448    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-home\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157623 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157598    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-tmp-dir\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.157734 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.157712    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-model-cache\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.159913 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.159884    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-dshm\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.160035 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.160018    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0009936-d6fe-4330-b354-dd7207ce36f8-tls-certs\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.169867 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.169841    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b69vc\" (UniqueName: \"kubernetes.io/projected/f0009936-d6fe-4330-b354-dd7207ce36f8-kube-api-access-b69vc\") pod \"sub-test-model-497679-kserve-c5b778fd7-7r726\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") " pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.312261 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.312225    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:05.459783 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.459756    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"]
Aug 04 09:58:05.461542 ip-10-0-143-202 kubenswrapper[2554]: W0804 09:58:05.461517    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0009936_d6fe_4330_b354_dd7207ce36f8.slice/crio-09440dce4a1cd3fd2958cc91582cee72a9df346dd58bfc0e1df7060a99772c50 WatchSource:0}: Error finding container 09440dce4a1cd3fd2958cc91582cee72a9df346dd58bfc0e1df7060a99772c50: Status 404 returned error can't find the container with id 09440dce4a1cd3fd2958cc91582cee72a9df346dd58bfc0e1df7060a99772c50
Aug 04 09:58:05.898673 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.898636    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726" event={"ID":"f0009936-d6fe-4330-b354-dd7207ce36f8","Type":"ContainerStarted","Data":"d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907"}
Aug 04 09:58:05.898673 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.898678    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726" event={"ID":"f0009936-d6fe-4330-b354-dd7207ce36f8","Type":"ContainerStarted","Data":"09440dce4a1cd3fd2958cc91582cee72a9df346dd58bfc0e1df7060a99772c50"}
Aug 04 09:58:05.919840 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:05.919792    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726" podStartSLOduration=1.919777615 podStartE2EDuration="1.919777615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:58:05.91808933 +0000 UTC m=+3035.663495764" watchObservedRunningTime="2026-08-04 09:58:05.919777615 +0000 UTC m=+3035.665184025"
Aug 04 09:58:15.312546 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:15.312500    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:15.312904 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:15.312557    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:15.324730 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:15.324709    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:15.959972 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:15.959935    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 09:58:31.086413 ip-10-0-143-202 kubenswrapper[2554]: I0804 09:58:31.086341    2554 scope.go:117] "RemoveContainer" containerID="660b44196fe21641d4227a9c6febfa2fd95bc81f11b8f6e2561b00edeb183751"
Aug 04 10:00:00.149401 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.149369    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"]
Aug 04 10:00:00.152847 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.152830    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"
Aug 04 10:00:00.157415 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.157391    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"]
Aug 04 10:00:00.158903 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.158873    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ftr4r\""
Aug 04 10:00:00.164220 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.163638    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"
Aug 04 10:00:00.168198 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.168005    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"]
Aug 04 10:00:00.173191 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.173168    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"
Aug 04 10:00:00.181093 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.181071    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"
Aug 04 10:00:00.197036 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.196995    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"]
Aug 04 10:00:00.339768 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.339735    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"]
Aug 04 10:00:00.343082 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:00:00.343054    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060123a5_880a_4742_ab42_5db39ec3b6f1.slice/crio-c852422fb5520e2771e0ea3d632c980b1f0fd049f28059f7b0ac241a4ef01d2c WatchSource:0}: Error finding container c852422fb5520e2771e0ea3d632c980b1f0fd049f28059f7b0ac241a4ef01d2c: Status 404 returned error can't find the container with id c852422fb5520e2771e0ea3d632c980b1f0fd049f28059f7b0ac241a4ef01d2c
Aug 04 10:00:00.450598 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.450509    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97" event={"ID":"060123a5-880a-4742-ab42-5db39ec3b6f1","Type":"ContainerStarted","Data":"c852422fb5520e2771e0ea3d632c980b1f0fd049f28059f7b0ac241a4ef01d2c"}
Aug 04 10:00:00.577624 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:00.577595    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"]
Aug 04 10:00:00.597724 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:00:00.597685    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb49a0d0_8fed_4e13_8be6_c58bbc3d7944.slice/crio-f63cdc82a985d7d341d658638ac927517f0158a50a619d48c5cfcea479b7798e WatchSource:0}: Error finding container f63cdc82a985d7d341d658638ac927517f0158a50a619d48c5cfcea479b7798e: Status 404 returned error can't find the container with id f63cdc82a985d7d341d658638ac927517f0158a50a619d48c5cfcea479b7798e
Aug 04 10:00:01.154585 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:01.154545    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"]
Aug 04 10:00:01.457828 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:01.457740    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4" event={"ID":"cb49a0d0-8fed-4e13-8be6-c58bbc3d7944","Type":"ContainerStarted","Data":"f2ed22427d52582b60d1194d7124181127d380f450e162d8ada6aecbd4b65fac"}
Aug 04 10:00:01.457828 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:01.457804    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4" event={"ID":"cb49a0d0-8fed-4e13-8be6-c58bbc3d7944","Type":"ContainerStarted","Data":"f63cdc82a985d7d341d658638ac927517f0158a50a619d48c5cfcea479b7798e"}
Aug 04 10:00:01.459310 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:01.459279    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97" event={"ID":"060123a5-880a-4742-ab42-5db39ec3b6f1","Type":"ContainerStarted","Data":"2edbe0a2ead5695e5036b3c31e4f548173ae7623856553d0758a82d161a5d3ff"}
Aug 04 10:00:01.522729 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:01.522681    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97" podStartSLOduration=1.5226596369999998 podStartE2EDuration="1.522659637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:00:01.522138381 +0000 UTC m=+3151.267544791" watchObservedRunningTime="2026-08-04 10:00:01.522659637 +0000 UTC m=+3151.268066050"
Aug 04 10:00:01.523609 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:01.523580    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4" podStartSLOduration=1.5235723559999998 podStartE2EDuration="1.523572356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:00:01.489836753 +0000 UTC m=+3151.235243164" watchObservedRunningTime="2026-08-04 10:00:01.523572356 +0000 UTC m=+3151.268978767"
Aug 04 10:00:02.465236 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:02.465197    2554 generic.go:356] "Generic (PLEG): container finished" podID="060123a5-880a-4742-ab42-5db39ec3b6f1" containerID="2edbe0a2ead5695e5036b3c31e4f548173ae7623856553d0758a82d161a5d3ff" exitCode=0
Aug 04 10:00:02.465711 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:02.465286    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97" event={"ID":"060123a5-880a-4742-ab42-5db39ec3b6f1","Type":"ContainerDied","Data":"2edbe0a2ead5695e5036b3c31e4f548173ae7623856553d0758a82d161a5d3ff"}
Aug 04 10:00:02.466766 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:02.466743    2554 generic.go:356] "Generic (PLEG): container finished" podID="cb49a0d0-8fed-4e13-8be6-c58bbc3d7944" containerID="f2ed22427d52582b60d1194d7124181127d380f450e162d8ada6aecbd4b65fac" exitCode=0
Aug 04 10:00:02.466818 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:02.466805    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4" event={"ID":"cb49a0d0-8fed-4e13-8be6-c58bbc3d7944","Type":"ContainerDied","Data":"f2ed22427d52582b60d1194d7124181127d380f450e162d8ada6aecbd4b65fac"}
Aug 04 10:00:03.614467 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:03.614422    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"
Aug 04 10:00:03.648923 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:03.648892    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"
Aug 04 10:00:04.478015 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:04.477986    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"
Aug 04 10:00:04.478207 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:04.477979    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97" event={"ID":"060123a5-880a-4742-ab42-5db39ec3b6f1","Type":"ContainerDied","Data":"c852422fb5520e2771e0ea3d632c980b1f0fd049f28059f7b0ac241a4ef01d2c"}
Aug 04 10:00:04.478207 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:04.478121    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c852422fb5520e2771e0ea3d632c980b1f0fd049f28059f7b0ac241a4ef01d2c"
Aug 04 10:00:04.479471 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:04.479431    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4" event={"ID":"cb49a0d0-8fed-4e13-8be6-c58bbc3d7944","Type":"ContainerDied","Data":"f63cdc82a985d7d341d658638ac927517f0158a50a619d48c5cfcea479b7798e"}
Aug 04 10:00:04.479600 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:04.479443    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"
Aug 04 10:00:04.479600 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:04.479497    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f63cdc82a985d7d341d658638ac927517f0158a50a619d48c5cfcea479b7798e"
Aug 04 10:00:16.174121 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.174052    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726" podUID="f0009936-d6fe-4330-b354-dd7207ce36f8" containerName="main" containerID="cri-o://d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907" gracePeriod=45
Aug 04 10:00:16.425568 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.425487    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 10:00:16.523426 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523379    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b69vc\" (UniqueName: \"kubernetes.io/projected/f0009936-d6fe-4330-b354-dd7207ce36f8-kube-api-access-b69vc\") pod \"f0009936-d6fe-4330-b354-dd7207ce36f8\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") "
Aug 04 10:00:16.523426 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523433    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-home\") pod \"f0009936-d6fe-4330-b354-dd7207ce36f8\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") "
Aug 04 10:00:16.523700 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523493    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-tmp-dir\") pod \"f0009936-d6fe-4330-b354-dd7207ce36f8\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") "
Aug 04 10:00:16.523700 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523534    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0009936-d6fe-4330-b354-dd7207ce36f8-tls-certs\") pod \"f0009936-d6fe-4330-b354-dd7207ce36f8\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") "
Aug 04 10:00:16.523700 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523557    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-model-cache\") pod \"f0009936-d6fe-4330-b354-dd7207ce36f8\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") "
Aug 04 10:00:16.523700 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523580    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-dshm\") pod \"f0009936-d6fe-4330-b354-dd7207ce36f8\" (UID: \"f0009936-d6fe-4330-b354-dd7207ce36f8\") "
Aug 04 10:00:16.523908 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523730    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-home" (OuterVolumeSpecName: "home") pod "f0009936-d6fe-4330-b354-dd7207ce36f8" (UID: "f0009936-d6fe-4330-b354-dd7207ce36f8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:00:16.523908 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523789    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0009936-d6fe-4330-b354-dd7207ce36f8" (UID: "f0009936-d6fe-4330-b354-dd7207ce36f8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:00:16.523908 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523833    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0009936-d6fe-4330-b354-dd7207ce36f8" (UID: "f0009936-d6fe-4330-b354-dd7207ce36f8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:00:16.524051 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523962    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-home\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:00:16.524051 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523980    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-tmp-dir\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:00:16.524051 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.523995    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-model-cache\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:00:16.525846 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.525819    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0009936-d6fe-4330-b354-dd7207ce36f8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0009936-d6fe-4330-b354-dd7207ce36f8" (UID: "f0009936-d6fe-4330-b354-dd7207ce36f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:00:16.525943 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.525842    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-dshm" (OuterVolumeSpecName: "dshm") pod "f0009936-d6fe-4330-b354-dd7207ce36f8" (UID: "f0009936-d6fe-4330-b354-dd7207ce36f8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:00:16.525943 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.525842    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0009936-d6fe-4330-b354-dd7207ce36f8-kube-api-access-b69vc" (OuterVolumeSpecName: "kube-api-access-b69vc") pod "f0009936-d6fe-4330-b354-dd7207ce36f8" (UID: "f0009936-d6fe-4330-b354-dd7207ce36f8"). InnerVolumeSpecName "kube-api-access-b69vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:00:16.537828 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.537798    2554 generic.go:356] "Generic (PLEG): container finished" podID="f0009936-d6fe-4330-b354-dd7207ce36f8" containerID="d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907" exitCode=0
Aug 04 10:00:16.537940 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.537837    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726" event={"ID":"f0009936-d6fe-4330-b354-dd7207ce36f8","Type":"ContainerDied","Data":"d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907"}
Aug 04 10:00:16.537940 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.537853    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"
Aug 04 10:00:16.537940 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.537893    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726" event={"ID":"f0009936-d6fe-4330-b354-dd7207ce36f8","Type":"ContainerDied","Data":"09440dce4a1cd3fd2958cc91582cee72a9df346dd58bfc0e1df7060a99772c50"}
Aug 04 10:00:16.537940 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.537921    2554 scope.go:117] "RemoveContainer" containerID="d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907"
Aug 04 10:00:16.548973 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.548949    2554 scope.go:117] "RemoveContainer" containerID="d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907"
Aug 04 10:00:16.549214 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:00:16.549196    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907\": container with ID starting with d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907 not found: ID does not exist" containerID="d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907"
Aug 04 10:00:16.549279 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.549223    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907"} err="failed to get container status \"d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907\": rpc error: code = NotFound desc = could not find container \"d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907\": container with ID starting with d35d0a10add3b077308ec14c5eca624047e9ba6e69159b9766ce9ad50cd34907 not found: ID does not exist"
Aug 04 10:00:16.562823 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.562791    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"]
Aug 04 10:00:16.567664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.567639    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-497679/sub-test-model-497679-kserve-c5b778fd7-7r726"]
Aug 04 10:00:16.624993 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.624958    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b69vc\" (UniqueName: \"kubernetes.io/projected/f0009936-d6fe-4330-b354-dd7207ce36f8-kube-api-access-b69vc\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:00:16.624993 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.624992    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0009936-d6fe-4330-b354-dd7207ce36f8-tls-certs\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:00:16.624993 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.625003    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0009936-d6fe-4330-b354-dd7207ce36f8-dshm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:00:16.782691 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:16.782608    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0009936-d6fe-4330-b354-dd7207ce36f8" path="/var/lib/kubelet/pods/f0009936-d6fe-4330-b354-dd7207ce36f8/volumes"
Aug 04 10:00:21.659205 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659167    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"]
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659553    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0009936-d6fe-4330-b354-dd7207ce36f8" containerName="main"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659564    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0009936-d6fe-4330-b354-dd7207ce36f8" containerName="main"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659577    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="060123a5-880a-4742-ab42-5db39ec3b6f1" containerName="cleanup"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659582    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="060123a5-880a-4742-ab42-5db39ec3b6f1" containerName="cleanup"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659593    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb49a0d0-8fed-4e13-8be6-c58bbc3d7944" containerName="cleanup"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659599    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb49a0d0-8fed-4e13-8be6-c58bbc3d7944" containerName="cleanup"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659650    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb49a0d0-8fed-4e13-8be6-c58bbc3d7944" containerName="cleanup"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659659    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0009936-d6fe-4330-b354-dd7207ce36f8" containerName="main"
Aug 04 10:00:21.659720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.659669    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="060123a5-880a-4742-ab42-5db39ec3b6f1" containerName="cleanup"
Aug 04 10:00:21.664523 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.664506    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.672154 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.672132    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"kube-root-ca.crt\""
Aug 04 10:00:21.672154 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.672132    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"default-dockercfg-q72m6\""
Aug 04 10:00:21.672337 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.672167    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"rate-test-model-497679-kserve-self-signed-certs\""
Aug 04 10:00:21.672337 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.672168    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-497679\"/\"openshift-service-ca.crt\""
Aug 04 10:00:21.678283 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.678260    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"]
Aug 04 10:00:21.769569 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.769533    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-home\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.769736 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.769584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-tmp-dir\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.769736 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.769603    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-dshm\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.769736 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.769642    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-model-cache\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.769736 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.769677    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6rw\" (UniqueName: \"kubernetes.io/projected/f0e96735-48af-419a-b784-e2b79c7ded76-kube-api-access-ct6rw\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.769881 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.769781    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e96735-48af-419a-b784-e2b79c7ded76-tls-certs\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871037 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.870997    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e96735-48af-419a-b784-e2b79c7ded76-tls-certs\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871037 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-home\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871310 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871092    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-tmp-dir\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871310 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871112    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-dshm\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871310 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871129    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-model-cache\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871310 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871158    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6rw\" (UniqueName: \"kubernetes.io/projected/f0e96735-48af-419a-b784-e2b79c7ded76-kube-api-access-ct6rw\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871627 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871603    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-model-cache\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871690 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871631    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-home\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.871690 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.871664    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-tmp-dir\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.873919 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.873893    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-dshm\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.874312 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.874290    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e96735-48af-419a-b784-e2b79c7ded76-tls-certs\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.881380 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.881350    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6rw\" (UniqueName: \"kubernetes.io/projected/f0e96735-48af-419a-b784-e2b79c7ded76-kube-api-access-ct6rw\") pod \"rate-test-model-497679-kserve-7754cfbf47-5rx4n\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") " pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:21.974420 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:21.974336    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:22.113885 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:22.113820    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"]
Aug 04 10:00:22.116689 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:00:22.116656    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0e96735_48af_419a_b784_e2b79c7ded76.slice/crio-6a278510ab9895789ebe7e1e9ed60a5c46b230133c04b8172f6665ae01fafac3 WatchSource:0}: Error finding container 6a278510ab9895789ebe7e1e9ed60a5c46b230133c04b8172f6665ae01fafac3: Status 404 returned error can't find the container with id 6a278510ab9895789ebe7e1e9ed60a5c46b230133c04b8172f6665ae01fafac3
Aug 04 10:00:22.570138 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:22.570101    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n" event={"ID":"f0e96735-48af-419a-b784-e2b79c7ded76","Type":"ContainerStarted","Data":"b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1"}
Aug 04 10:00:22.570138 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:22.570144    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n" event={"ID":"f0e96735-48af-419a-b784-e2b79c7ded76","Type":"ContainerStarted","Data":"6a278510ab9895789ebe7e1e9ed60a5c46b230133c04b8172f6665ae01fafac3"}
Aug 04 10:00:22.592013 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:22.591955    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n" podStartSLOduration=1.591939414 podStartE2EDuration="1.591939414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:00:22.591225017 +0000 UTC m=+3172.336631439" watchObservedRunningTime="2026-08-04 10:00:22.591939414 +0000 UTC m=+3172.337345824"
Aug 04 10:00:31.975258 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:31.975221    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:31.975699 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:31.975274    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:31.987983 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:31.987957    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:00:32.631761 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:00:32.631728    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:01:49.681333 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:01:49.681299    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"]
Aug 04 10:02:04.700621 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.700558    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n" podUID="f0e96735-48af-419a-b784-e2b79c7ded76" containerName="main" containerID="cri-o://b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1" gracePeriod=45
Aug 04 10:02:04.953061 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.952999    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:02:04.985434 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.985399    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-dshm\") pod \"f0e96735-48af-419a-b784-e2b79c7ded76\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") "
Aug 04 10:02:04.985651 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.985469    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct6rw\" (UniqueName: \"kubernetes.io/projected/f0e96735-48af-419a-b784-e2b79c7ded76-kube-api-access-ct6rw\") pod \"f0e96735-48af-419a-b784-e2b79c7ded76\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") "
Aug 04 10:02:04.985651 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.985551    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-model-cache\") pod \"f0e96735-48af-419a-b784-e2b79c7ded76\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") "
Aug 04 10:02:04.985651 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.985582    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e96735-48af-419a-b784-e2b79c7ded76-tls-certs\") pod \"f0e96735-48af-419a-b784-e2b79c7ded76\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") "
Aug 04 10:02:04.985651 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.985650    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-tmp-dir\") pod \"f0e96735-48af-419a-b784-e2b79c7ded76\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") "
Aug 04 10:02:04.985893 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.985698    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-home\") pod \"f0e96735-48af-419a-b784-e2b79c7ded76\" (UID: \"f0e96735-48af-419a-b784-e2b79c7ded76\") "
Aug 04 10:02:04.985893 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.985860    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0e96735-48af-419a-b784-e2b79c7ded76" (UID: "f0e96735-48af-419a-b784-e2b79c7ded76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:02:04.986088 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.986031    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0e96735-48af-419a-b784-e2b79c7ded76" (UID: "f0e96735-48af-419a-b784-e2b79c7ded76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:02:04.986088 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.986060    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-home" (OuterVolumeSpecName: "home") pod "f0e96735-48af-419a-b784-e2b79c7ded76" (UID: "f0e96735-48af-419a-b784-e2b79c7ded76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:02:04.986088 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.986048    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-model-cache\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:02:04.987804 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.987776    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-dshm" (OuterVolumeSpecName: "dshm") pod "f0e96735-48af-419a-b784-e2b79c7ded76" (UID: "f0e96735-48af-419a-b784-e2b79c7ded76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:02:04.987905 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.987812    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e96735-48af-419a-b784-e2b79c7ded76-kube-api-access-ct6rw" (OuterVolumeSpecName: "kube-api-access-ct6rw") pod "f0e96735-48af-419a-b784-e2b79c7ded76" (UID: "f0e96735-48af-419a-b784-e2b79c7ded76"). InnerVolumeSpecName "kube-api-access-ct6rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:02:04.987905 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:04.987820    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e96735-48af-419a-b784-e2b79c7ded76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0e96735-48af-419a-b784-e2b79c7ded76" (UID: "f0e96735-48af-419a-b784-e2b79c7ded76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:02:05.072930 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.072890    2554 generic.go:356] "Generic (PLEG): container finished" podID="f0e96735-48af-419a-b784-e2b79c7ded76" containerID="b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1" exitCode=0
Aug 04 10:02:05.073128 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.072938    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"
Aug 04 10:02:05.073128 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.072974    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n" event={"ID":"f0e96735-48af-419a-b784-e2b79c7ded76","Type":"ContainerDied","Data":"b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1"}
Aug 04 10:02:05.073128 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.073018    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n" event={"ID":"f0e96735-48af-419a-b784-e2b79c7ded76","Type":"ContainerDied","Data":"6a278510ab9895789ebe7e1e9ed60a5c46b230133c04b8172f6665ae01fafac3"}
Aug 04 10:02:05.073128 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.073040    2554 scope.go:117] "RemoveContainer" containerID="b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1"
Aug 04 10:02:05.082728 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.082706    2554 scope.go:117] "RemoveContainer" containerID="b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1"
Aug 04 10:02:05.083021 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:02:05.083002    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1\": container with ID starting with b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1 not found: ID does not exist" containerID="b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1"
Aug 04 10:02:05.083081 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.083032    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1"} err="failed to get container status \"b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1\": rpc error: code = NotFound desc = could not find container \"b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1\": container with ID starting with b3a9a435d2c606cd3076cca0cbaf9dbe132633b18f730f5b62e4c122918b8cb1 not found: ID does not exist"
Aug 04 10:02:05.086553 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.086532    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e96735-48af-419a-b784-e2b79c7ded76-tls-certs\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:02:05.086645 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.086556    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-tmp-dir\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:02:05.086645 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.086568    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-home\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:02:05.086645 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.086580    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e96735-48af-419a-b784-e2b79c7ded76-dshm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:02:05.086645 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.086593    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct6rw\" (UniqueName: \"kubernetes.io/projected/f0e96735-48af-419a-b784-e2b79c7ded76-kube-api-access-ct6rw\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:02:05.097323 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.097296    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"]
Aug 04 10:02:05.103711 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:05.103688    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-497679/rate-test-model-497679-kserve-7754cfbf47-5rx4n"]
Aug 04 10:02:06.782291 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:06.782255    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e96735-48af-419a-b784-e2b79c7ded76" path="/var/lib/kubelet/pods/f0e96735-48af-419a-b784-e2b79c7ded76/volumes"
Aug 04 10:02:14.205654 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.205621    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"]
Aug 04 10:02:14.206097 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.205988    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0e96735-48af-419a-b784-e2b79c7ded76" containerName="main"
Aug 04 10:02:14.206097 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.205999    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e96735-48af-419a-b784-e2b79c7ded76" containerName="main"
Aug 04 10:02:14.206097 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.206053    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0e96735-48af-419a-b784-e2b79c7ded76" containerName="main"
Aug 04 10:02:14.209021 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.209005    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.211603 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.211582    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-fc7b93-serving-cert\""
Aug 04 10:02:14.221106 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.221083    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"]
Aug 04 10:02:14.267134 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.267100    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlct\" (UniqueName: \"kubernetes.io/projected/45d6613c-bac0-4d9a-be03-50352acad665-kube-api-access-shlct\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.267289 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.267152    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d6613c-bac0-4d9a-be03-50352acad665-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.267289 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.267198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.368463 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.368420    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlct\" (UniqueName: \"kubernetes.io/projected/45d6613c-bac0-4d9a-be03-50352acad665-kube-api-access-shlct\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.368684 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.368533    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d6613c-bac0-4d9a-be03-50352acad665-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.368684 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.368562    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.368684 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:02:14.368671    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-serving-cert: secret "maas-api-e2e-ipp-a-fc7b93-serving-cert" not found
Aug 04 10:02:14.368858 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:02:14.368738    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls podName:45d6613c-bac0-4d9a-be03-50352acad665 nodeName:}" failed. No retries permitted until 2026-08-04 10:02:14.868722148 +0000 UTC m=+3284.614128537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls") pod "maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln" (UID: "45d6613c-bac0-4d9a-be03-50352acad665") : secret "maas-api-e2e-ipp-a-fc7b93-serving-cert" not found
Aug 04 10:02:14.369165 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.369144    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d6613c-bac0-4d9a-be03-50352acad665-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.378578 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.378549    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlct\" (UniqueName: \"kubernetes.io/projected/45d6613c-bac0-4d9a-be03-50352acad665-kube-api-access-shlct\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.872284 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.872248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:14.875095 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:14.875053    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:15.118928 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:15.118891    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:15.266268 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:15.266237    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"]
Aug 04 10:02:15.269666 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:02:15.269638    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d6613c_bac0_4d9a_be03_50352acad665.slice/crio-5dcfb6af57200a205adb54a7811dc65869766ca39a519254648d00ee7b7cf1e3 WatchSource:0}: Error finding container 5dcfb6af57200a205adb54a7811dc65869766ca39a519254648d00ee7b7cf1e3: Status 404 returned error can't find the container with id 5dcfb6af57200a205adb54a7811dc65869766ca39a519254648d00ee7b7cf1e3
Aug 04 10:02:15.271309 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:15.271293    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 10:02:16.128894 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:16.128798    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln" event={"ID":"45d6613c-bac0-4d9a-be03-50352acad665","Type":"ContainerStarted","Data":"bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7"}
Aug 04 10:02:16.128894 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:16.128879    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln" event={"ID":"45d6613c-bac0-4d9a-be03-50352acad665","Type":"ContainerStarted","Data":"5dcfb6af57200a205adb54a7811dc65869766ca39a519254648d00ee7b7cf1e3"}
Aug 04 10:02:16.129098 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:16.128948    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:16.153329 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:16.153285    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln" podStartSLOduration=1.570813067 podStartE2EDuration="2.153270554s" totalImagesPullingTime="582.457487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:02:16.149992828 +0000 UTC m=+3285.895399239" watchObservedRunningTime="2026-08-04 10:02:16.153270554 +0000 UTC m=+3285.898676964"
Aug 04 10:02:22.140152 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:22.140113    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:02:30.975297 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:30.975191    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 10:02:30.979832 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:30.978558    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 10:02:30.982656 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:30.982631    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 10:02:30.985839 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:30.985817    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 10:02:43.617608 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.617572    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"]
Aug 04 10:02:43.621192 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.621168    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.624251 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.624228    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-90d908-serving-cert\""
Aug 04 10:02:43.637266 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.637239    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"]
Aug 04 10:02:43.721469 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.721416    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23be8ac9-4521-4f93-90fb-a6c98a4e1992-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.721469 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.721466    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.721696 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.721529    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wctnl\" (UniqueName: \"kubernetes.io/projected/23be8ac9-4521-4f93-90fb-a6c98a4e1992-kube-api-access-wctnl\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.823020 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.822983    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23be8ac9-4521-4f93-90fb-a6c98a4e1992-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.823214 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.823027    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.823214 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.823062    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wctnl\" (UniqueName: \"kubernetes.io/projected/23be8ac9-4521-4f93-90fb-a6c98a4e1992-kube-api-access-wctnl\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.823214 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:02:43.823154    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-serving-cert: secret "maas-api-e2e-ipp-b-90d908-serving-cert" not found
Aug 04 10:02:43.823420 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:02:43.823233    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls podName:23be8ac9-4521-4f93-90fb-a6c98a4e1992 nodeName:}" failed. No retries permitted until 2026-08-04 10:02:44.323211569 +0000 UTC m=+3314.068617961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls") pod "maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs" (UID: "23be8ac9-4521-4f93-90fb-a6c98a4e1992") : secret "maas-api-e2e-ipp-b-90d908-serving-cert" not found
Aug 04 10:02:43.823776 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.823752    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23be8ac9-4521-4f93-90fb-a6c98a4e1992-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:43.842755 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:43.842735    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wctnl\" (UniqueName: \"kubernetes.io/projected/23be8ac9-4521-4f93-90fb-a6c98a4e1992-kube-api-access-wctnl\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:44.328051 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:44.328013    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:44.330643 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:44.330615    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls\") pod \"maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:44.535341 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:44.535306    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:44.678898 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:44.678868    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"]
Aug 04 10:02:44.680840 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:02:44.680807    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23be8ac9_4521_4f93_90fb_a6c98a4e1992.slice/crio-88deb289b10651c6a74bef5cd916cdd9c133011d4b84b9d9afc02c56a1be5391 WatchSource:0}: Error finding container 88deb289b10651c6a74bef5cd916cdd9c133011d4b84b9d9afc02c56a1be5391: Status 404 returned error can't find the container with id 88deb289b10651c6a74bef5cd916cdd9c133011d4b84b9d9afc02c56a1be5391
Aug 04 10:02:45.270198 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:45.270163    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs" event={"ID":"23be8ac9-4521-4f93-90fb-a6c98a4e1992","Type":"ContainerStarted","Data":"97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2"}
Aug 04 10:02:45.270390 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:45.270212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs" event={"ID":"23be8ac9-4521-4f93-90fb-a6c98a4e1992","Type":"ContainerStarted","Data":"88deb289b10651c6a74bef5cd916cdd9c133011d4b84b9d9afc02c56a1be5391"}
Aug 04 10:02:45.270390 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:45.270307    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:02:45.291902 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:45.291784    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs" podStartSLOduration=1.9490302050000001 podStartE2EDuration="2.29176574s" totalImagesPullingTime="342.735535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:02:45.291267129 +0000 UTC m=+3315.036673569" watchObservedRunningTime="2026-08-04 10:02:45.29176574 +0000 UTC m=+3315.037172151"
Aug 04 10:02:51.282089 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:02:51.282057    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:03:16.445827 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.445792    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"]
Aug 04 10:03:16.449289 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.449270    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.453726 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.453702    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fc7b93\"/\"default-dockercfg-wcqtv\""
Aug 04 10:03:16.454297 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.454275    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fc7b93\"/\"kube-root-ca.crt\""
Aug 04 10:03:16.454297 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.454268    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fc7b93\"/\"openshift-service-ca.crt\""
Aug 04 10:03:16.454547 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.454362    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fc7b93\"/\"ipp-route-fc7b93-kserve-self-signed-certs\""
Aug 04 10:03:16.462212 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.462192    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"]
Aug 04 10:03:16.616591 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.616551    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-tmp-dir\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.616774 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.616606    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s75jd\" (UniqueName: \"kubernetes.io/projected/9239d274-6382-415d-b28a-6029ce927fa8-kube-api-access-s75jd\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.616774 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.616672    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-home\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.616774 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.616741    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9239d274-6382-415d-b28a-6029ce927fa8-tls-certs\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.616882 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.616846    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-dshm\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.616929 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.616882    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-model-cache\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.717662 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.717571    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-dshm\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.717662 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.717605    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-model-cache\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.717662 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.717644    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-tmp-dir\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.717924 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.717807    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s75jd\" (UniqueName: \"kubernetes.io/projected/9239d274-6382-415d-b28a-6029ce927fa8-kube-api-access-s75jd\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.717924 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.717861    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-home\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.717924 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.717879    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9239d274-6382-415d-b28a-6029ce927fa8-tls-certs\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.718085 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.718000    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-model-cache\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.718085 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.718050    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-tmp-dir\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.718277 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.718253    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-home\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.720223 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.720193    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-dshm\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.720517 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.720496    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9239d274-6382-415d-b28a-6029ce927fa8-tls-certs\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.728033 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.728005    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s75jd\" (UniqueName: \"kubernetes.io/projected/9239d274-6382-415d-b28a-6029ce927fa8-kube-api-access-s75jd\") pod \"ipp-route-fc7b93-kserve-7777f69f67-bkphq\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") " pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.761124 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.761095    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:16.909013 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:16.908908    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"]
Aug 04 10:03:16.911712 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:03:16.911683    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9239d274_6382_415d_b28a_6029ce927fa8.slice/crio-d67c155b4ae9910bd4f6ffdc20e1ff933c4001a29eff29a92442ec7c8c3309d9 WatchSource:0}: Error finding container d67c155b4ae9910bd4f6ffdc20e1ff933c4001a29eff29a92442ec7c8c3309d9: Status 404 returned error can't find the container with id d67c155b4ae9910bd4f6ffdc20e1ff933c4001a29eff29a92442ec7c8c3309d9
Aug 04 10:03:17.425789 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:17.425752    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq" event={"ID":"9239d274-6382-415d-b28a-6029ce927fa8","Type":"ContainerStarted","Data":"19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae"}
Aug 04 10:03:17.425789 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:17.425793    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq" event={"ID":"9239d274-6382-415d-b28a-6029ce927fa8","Type":"ContainerStarted","Data":"d67c155b4ae9910bd4f6ffdc20e1ff933c4001a29eff29a92442ec7c8c3309d9"}
Aug 04 10:03:17.447500 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:17.447429    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq" podStartSLOduration=1.447414582 podStartE2EDuration="1.447414582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:03:17.445378487 +0000 UTC m=+3347.190784893" watchObservedRunningTime="2026-08-04 10:03:17.447414582 +0000 UTC m=+3347.192820992"
Aug 04 10:03:26.761637 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:26.761596    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:26.761637 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:26.761645    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:26.774572 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:26.774545    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:03:27.495291 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:03:27.495262    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:04:20.099991 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.099947    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"]
Aug 04 10:04:20.103923 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.103899    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.107554 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.107524    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-e0d739-serving-cert\""
Aug 04 10:04:20.121914 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.121887    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"]
Aug 04 10:04:20.197411 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.197373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.197608 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.197426    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ppt\" (UniqueName: \"kubernetes.io/projected/895105d1-f123-439b-b24f-63a94b9fec0a-kube-api-access-x6ppt\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.197608 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.197585    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/895105d1-f123-439b-b24f-63a94b9fec0a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.298822 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.298769    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/895105d1-f123-439b-b24f-63a94b9fec0a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.299001 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.298843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.299001 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.298869    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ppt\" (UniqueName: \"kubernetes.io/projected/895105d1-f123-439b-b24f-63a94b9fec0a-kube-api-access-x6ppt\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.299001 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:04:20.298992    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-serving-cert: secret "maas-api-e2e-ipp-cleanup-e0d739-serving-cert" not found
Aug 04 10:04:20.299111 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:04:20.299068    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls podName:895105d1-f123-439b-b24f-63a94b9fec0a nodeName:}" failed. No retries permitted until 2026-08-04 10:04:20.799050077 +0000 UTC m=+3410.544456465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5" (UID: "895105d1-f123-439b-b24f-63a94b9fec0a") : secret "maas-api-e2e-ipp-cleanup-e0d739-serving-cert" not found
Aug 04 10:04:20.299538 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.299521    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/895105d1-f123-439b-b24f-63a94b9fec0a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.308809 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.308786    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ppt\" (UniqueName: \"kubernetes.io/projected/895105d1-f123-439b-b24f-63a94b9fec0a-kube-api-access-x6ppt\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.804403 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.804367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:20.806943 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:20.806924    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:21.014144 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:21.014105    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:21.170728 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:21.170703    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"]
Aug 04 10:04:21.173408 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:04:21.173368    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895105d1_f123_439b_b24f_63a94b9fec0a.slice/crio-86fd0f5c8dd673262b7347f8fd4dafa91128c469e6a273eadd661c2d3170a611 WatchSource:0}: Error finding container 86fd0f5c8dd673262b7347f8fd4dafa91128c469e6a273eadd661c2d3170a611: Status 404 returned error can't find the container with id 86fd0f5c8dd673262b7347f8fd4dafa91128c469e6a273eadd661c2d3170a611
Aug 04 10:04:21.755678 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:21.755633    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5" event={"ID":"895105d1-f123-439b-b24f-63a94b9fec0a","Type":"ContainerStarted","Data":"6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7"}
Aug 04 10:04:21.755845 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:21.755695    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5" event={"ID":"895105d1-f123-439b-b24f-63a94b9fec0a","Type":"ContainerStarted","Data":"86fd0f5c8dd673262b7347f8fd4dafa91128c469e6a273eadd661c2d3170a611"}
Aug 04 10:04:21.755845 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:21.755715    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:21.776316 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:21.776266    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5" podStartSLOduration=1.3265038470000001 podStartE2EDuration="1.77625087s" totalImagesPullingTime="449.747023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:04:21.774582405 +0000 UTC m=+3411.519988842" watchObservedRunningTime="2026-08-04 10:04:21.77625087 +0000 UTC m=+3411.521657281"
Aug 04 10:04:27.767557 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:27.767504    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:44.588401 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.588363    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"]
Aug 04 10:04:44.591630 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.591613    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:44.595070 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.595048    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ftr4r\""
Aug 04 10:04:44.602374 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.602347    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"]
Aug 04 10:04:44.712266 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.712230    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/866d0115-ca57-46be-8c56-4b219462cdce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255\" (UID: \"866d0115-ca57-46be-8c56-4b219462cdce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:44.813540 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.813501    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/866d0115-ca57-46be-8c56-4b219462cdce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255\" (UID: \"866d0115-ca57-46be-8c56-4b219462cdce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:44.814100 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.814080    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/866d0115-ca57-46be-8c56-4b219462cdce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255\" (UID: \"866d0115-ca57-46be-8c56-4b219462cdce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:44.910302 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:44.910218    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:45.055795 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:45.055769    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"]
Aug 04 10:04:45.058557 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:04:45.058517    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866d0115_ca57_46be_8c56_4b219462cdce.slice/crio-ddc62e4b2e42b21085b01c7a76f22716908a2ac24c17d47a507ec7953edce045 WatchSource:0}: Error finding container ddc62e4b2e42b21085b01c7a76f22716908a2ac24c17d47a507ec7953edce045: Status 404 returned error can't find the container with id ddc62e4b2e42b21085b01c7a76f22716908a2ac24c17d47a507ec7953edce045
Aug 04 10:04:45.874401 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:45.874365    2554 generic.go:356] "Generic (PLEG): container finished" podID="866d0115-ca57-46be-8c56-4b219462cdce" containerID="12e956f79cdbf0da0c349e858557e4111459e0e3f161f59e61081af7fe188c24" exitCode=0
Aug 04 10:04:45.874878 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:45.874414    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255" event={"ID":"866d0115-ca57-46be-8c56-4b219462cdce","Type":"ContainerDied","Data":"12e956f79cdbf0da0c349e858557e4111459e0e3f161f59e61081af7fe188c24"}
Aug 04 10:04:45.874878 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:45.874486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255" event={"ID":"866d0115-ca57-46be-8c56-4b219462cdce","Type":"ContainerStarted","Data":"ddc62e4b2e42b21085b01c7a76f22716908a2ac24c17d47a507ec7953edce045"}
Aug 04 10:04:47.013309 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:47.013283    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:47.134725 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:47.134636    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/866d0115-ca57-46be-8c56-4b219462cdce-maas-api-service-ca\") pod \"866d0115-ca57-46be-8c56-4b219462cdce\" (UID: \"866d0115-ca57-46be-8c56-4b219462cdce\") "
Aug 04 10:04:47.134968 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:47.134946    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866d0115-ca57-46be-8c56-4b219462cdce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "866d0115-ca57-46be-8c56-4b219462cdce" (UID: "866d0115-ca57-46be-8c56-4b219462cdce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:04:47.236179 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:47.236140    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/866d0115-ca57-46be-8c56-4b219462cdce-maas-api-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:04:47.886129 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:47.886037    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255" event={"ID":"866d0115-ca57-46be-8c56-4b219462cdce","Type":"ContainerDied","Data":"ddc62e4b2e42b21085b01c7a76f22716908a2ac24c17d47a507ec7953edce045"}
Aug 04 10:04:47.886129 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:47.886064    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:47.886129 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:47.886091    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddc62e4b2e42b21085b01c7a76f22716908a2ac24c17d47a507ec7953edce045"
Aug 04 10:04:50.523484 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.523051    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"]
Aug 04 10:04:50.523484 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.523353    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5" podUID="895105d1-f123-439b-b24f-63a94b9fec0a" containerName="maas-api" containerID="cri-o://6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7" gracePeriod=30
Aug 04 10:04:50.772543 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.772484    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"]
Aug 04 10:04:50.781707 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:04:50.781628    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255\" is forbidden: User \"system:node:ip-10-0-143-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-143-202.ec2.internal' and this object" podUID="866d0115-ca57-46be-8c56-4b219462cdce" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"
Aug 04 10:04:50.782543 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.782523    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e0d739-gx255"]
Aug 04 10:04:50.788585 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.788565    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:50.866439 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.866406    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/895105d1-f123-439b-b24f-63a94b9fec0a-openshift-service-ca\") pod \"895105d1-f123-439b-b24f-63a94b9fec0a\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") "
Aug 04 10:04:50.866652 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.866524    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls\") pod \"895105d1-f123-439b-b24f-63a94b9fec0a\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") "
Aug 04 10:04:50.866652 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.866557    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6ppt\" (UniqueName: \"kubernetes.io/projected/895105d1-f123-439b-b24f-63a94b9fec0a-kube-api-access-x6ppt\") pod \"895105d1-f123-439b-b24f-63a94b9fec0a\" (UID: \"895105d1-f123-439b-b24f-63a94b9fec0a\") "
Aug 04 10:04:50.866848 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.866820    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895105d1-f123-439b-b24f-63a94b9fec0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "895105d1-f123-439b-b24f-63a94b9fec0a" (UID: "895105d1-f123-439b-b24f-63a94b9fec0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:04:50.866957 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.866935    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/895105d1-f123-439b-b24f-63a94b9fec0a-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:04:50.868742 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.868721    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "895105d1-f123-439b-b24f-63a94b9fec0a" (UID: "895105d1-f123-439b-b24f-63a94b9fec0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:04:50.868742 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.868725    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895105d1-f123-439b-b24f-63a94b9fec0a-kube-api-access-x6ppt" (OuterVolumeSpecName: "kube-api-access-x6ppt") pod "895105d1-f123-439b-b24f-63a94b9fec0a" (UID: "895105d1-f123-439b-b24f-63a94b9fec0a"). InnerVolumeSpecName "kube-api-access-x6ppt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:04:50.904883 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.904851    2554 generic.go:356] "Generic (PLEG): container finished" podID="895105d1-f123-439b-b24f-63a94b9fec0a" containerID="6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7" exitCode=0
Aug 04 10:04:50.905043 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.904904    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"
Aug 04 10:04:50.905043 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.904949    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5" event={"ID":"895105d1-f123-439b-b24f-63a94b9fec0a","Type":"ContainerDied","Data":"6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7"}
Aug 04 10:04:50.905043 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.905021    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5" event={"ID":"895105d1-f123-439b-b24f-63a94b9fec0a","Type":"ContainerDied","Data":"86fd0f5c8dd673262b7347f8fd4dafa91128c469e6a273eadd661c2d3170a611"}
Aug 04 10:04:50.905196 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.905057    2554 scope.go:117] "RemoveContainer" containerID="6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7"
Aug 04 10:04:50.915466 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.915432    2554 scope.go:117] "RemoveContainer" containerID="6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7"
Aug 04 10:04:50.915769 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:04:50.915749    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7\": container with ID starting with 6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7 not found: ID does not exist" containerID="6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7"
Aug 04 10:04:50.915824 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.915778    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7"} err="failed to get container status \"6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7\": rpc error: code = NotFound desc = could not find container \"6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7\": container with ID starting with 6a7858c57d6b523174a3e6d50d1a7fb0ad34876bc77bbf44ad86a191c6529ec7 not found: ID does not exist"
Aug 04 10:04:50.930529 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.930506    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"]
Aug 04 10:04:50.935701 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.935645    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e0d739-6b6bdbfd9-cmzx5"]
Aug 04 10:04:50.968264 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.968240    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/895105d1-f123-439b-b24f-63a94b9fec0a-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:04:50.968264 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:50.968267    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6ppt\" (UniqueName: \"kubernetes.io/projected/895105d1-f123-439b-b24f-63a94b9fec0a-kube-api-access-x6ppt\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:04:52.781720 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:52.781681    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866d0115-ca57-46be-8c56-4b219462cdce" path="/var/lib/kubelet/pods/866d0115-ca57-46be-8c56-4b219462cdce/volumes"
Aug 04 10:04:52.782244 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:04:52.782221    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="895105d1-f123-439b-b24f-63a94b9fec0a" path="/var/lib/kubelet/pods/895105d1-f123-439b-b24f-63a94b9fec0a/volumes"
Aug 04 10:05:01.140529 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.140484    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"]
Aug 04 10:05:01.140995 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.140901    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895105d1-f123-439b-b24f-63a94b9fec0a" containerName="maas-api"
Aug 04 10:05:01.140995 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.140913    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="895105d1-f123-439b-b24f-63a94b9fec0a" containerName="maas-api"
Aug 04 10:05:01.140995 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.140931    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866d0115-ca57-46be-8c56-4b219462cdce" containerName="revoke-keys"
Aug 04 10:05:01.140995 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.140937    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="866d0115-ca57-46be-8c56-4b219462cdce" containerName="revoke-keys"
Aug 04 10:05:01.141142 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.141013    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="866d0115-ca57-46be-8c56-4b219462cdce" containerName="revoke-keys"
Aug 04 10:05:01.141142 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.141022    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="895105d1-f123-439b-b24f-63a94b9fec0a" containerName="maas-api"
Aug 04 10:05:01.145574 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.145553    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"
Aug 04 10:05:01.148287 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.148264    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ftr4r\""
Aug 04 10:05:01.156274 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.156247    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"]
Aug 04 10:05:01.261071 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.261041    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4495ac-7659-469f-b028-9266c8b1fc0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf\" (UID: \"3a4495ac-7659-469f-b028-9266c8b1fc0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"
Aug 04 10:05:01.362505 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.362449    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4495ac-7659-469f-b028-9266c8b1fc0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf\" (UID: \"3a4495ac-7659-469f-b028-9266c8b1fc0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"
Aug 04 10:05:01.363070 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.363048    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4495ac-7659-469f-b028-9266c8b1fc0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf\" (UID: \"3a4495ac-7659-469f-b028-9266c8b1fc0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"
Aug 04 10:05:01.457104 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.457029    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"
Aug 04 10:05:01.609082 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.609056    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"]
Aug 04 10:05:01.610914 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:05:01.610889    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4495ac_7659_469f_b028_9266c8b1fc0f.slice/crio-808eedbec4ae3c188c01744c6b7ff61d298f95a33090fe8fd12a8c891315a4a3 WatchSource:0}: Error finding container 808eedbec4ae3c188c01744c6b7ff61d298f95a33090fe8fd12a8c891315a4a3: Status 404 returned error can't find the container with id 808eedbec4ae3c188c01744c6b7ff61d298f95a33090fe8fd12a8c891315a4a3
Aug 04 10:05:01.961193 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.961159    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf" event={"ID":"3a4495ac-7659-469f-b028-9266c8b1fc0f","Type":"ContainerStarted","Data":"8960b6d2f21c7795cc71c0c07b4647f9a6e8df00eeaf8cb62fbc74e9ffe6fc04"}
Aug 04 10:05:01.961353 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.961212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf" event={"ID":"3a4495ac-7659-469f-b028-9266c8b1fc0f","Type":"ContainerStarted","Data":"808eedbec4ae3c188c01744c6b7ff61d298f95a33090fe8fd12a8c891315a4a3"}
Aug 04 10:05:01.988123 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:01.988071    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf" podStartSLOduration=0.988057764 podStartE2EDuration="988.057764ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:05:01.986249507 +0000 UTC m=+3451.731655917" watchObservedRunningTime="2026-08-04 10:05:01.988057764 +0000 UTC m=+3451.733464175"
Aug 04 10:05:02.967002 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:02.966969    2554 generic.go:356] "Generic (PLEG): container finished" podID="3a4495ac-7659-469f-b028-9266c8b1fc0f" containerID="8960b6d2f21c7795cc71c0c07b4647f9a6e8df00eeaf8cb62fbc74e9ffe6fc04" exitCode=0
Aug 04 10:05:02.967391 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:02.967056    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf" event={"ID":"3a4495ac-7659-469f-b028-9266c8b1fc0f","Type":"ContainerDied","Data":"8960b6d2f21c7795cc71c0c07b4647f9a6e8df00eeaf8cb62fbc74e9ffe6fc04"}
Aug 04 10:05:04.110790 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:04.110766    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"
Aug 04 10:05:04.288789 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:04.288674    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4495ac-7659-469f-b028-9266c8b1fc0f-maas-api-service-ca\") pod \"3a4495ac-7659-469f-b028-9266c8b1fc0f\" (UID: \"3a4495ac-7659-469f-b028-9266c8b1fc0f\") "
Aug 04 10:05:04.288996 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:04.288972    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a4495ac-7659-469f-b028-9266c8b1fc0f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a4495ac-7659-469f-b028-9266c8b1fc0f" (UID: "3a4495ac-7659-469f-b028-9266c8b1fc0f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:05:04.389326 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:04.389285    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a4495ac-7659-469f-b028-9266c8b1fc0f-maas-api-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:04.978397 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:04.978361    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf" event={"ID":"3a4495ac-7659-469f-b028-9266c8b1fc0f","Type":"ContainerDied","Data":"808eedbec4ae3c188c01744c6b7ff61d298f95a33090fe8fd12a8c891315a4a3"}
Aug 04 10:05:04.978586 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:04.978410    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="808eedbec4ae3c188c01744c6b7ff61d298f95a33090fe8fd12a8c891315a4a3"
Aug 04 10:05:04.978586 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:04.978371    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"
Aug 04 10:05:16.661639 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:16.661601    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"]
Aug 04 10:05:16.662052 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:16.661814    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln" podUID="45d6613c-bac0-4d9a-be03-50352acad665" containerName="maas-api" containerID="cri-o://bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7" gracePeriod=30
Aug 04 10:05:16.917942 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:16.917876    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:05:16.955749 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:16.955722    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"]
Aug 04 10:05:16.960071 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:16.960040    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fc7b93-k28rf"]
Aug 04 10:05:17.000700 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.000663    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d6613c-bac0-4d9a-be03-50352acad665-openshift-service-ca\") pod \"45d6613c-bac0-4d9a-be03-50352acad665\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") "
Aug 04 10:05:17.000873 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.000749    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls\") pod \"45d6613c-bac0-4d9a-be03-50352acad665\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") "
Aug 04 10:05:17.000873 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.000820    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shlct\" (UniqueName: \"kubernetes.io/projected/45d6613c-bac0-4d9a-be03-50352acad665-kube-api-access-shlct\") pod \"45d6613c-bac0-4d9a-be03-50352acad665\" (UID: \"45d6613c-bac0-4d9a-be03-50352acad665\") "
Aug 04 10:05:17.001093 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.001065    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d6613c-bac0-4d9a-be03-50352acad665-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45d6613c-bac0-4d9a-be03-50352acad665" (UID: "45d6613c-bac0-4d9a-be03-50352acad665"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:05:17.003200 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.003174    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45d6613c-bac0-4d9a-be03-50352acad665" (UID: "45d6613c-bac0-4d9a-be03-50352acad665"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:05:17.003340 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.003324    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d6613c-bac0-4d9a-be03-50352acad665-kube-api-access-shlct" (OuterVolumeSpecName: "kube-api-access-shlct") pod "45d6613c-bac0-4d9a-be03-50352acad665" (UID: "45d6613c-bac0-4d9a-be03-50352acad665"). InnerVolumeSpecName "kube-api-access-shlct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:05:17.036174 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.036141    2554 generic.go:356] "Generic (PLEG): container finished" podID="45d6613c-bac0-4d9a-be03-50352acad665" containerID="bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7" exitCode=0
Aug 04 10:05:17.036321 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.036188    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"
Aug 04 10:05:17.036321 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.036242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln" event={"ID":"45d6613c-bac0-4d9a-be03-50352acad665","Type":"ContainerDied","Data":"bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7"}
Aug 04 10:05:17.036321 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.036306    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln" event={"ID":"45d6613c-bac0-4d9a-be03-50352acad665","Type":"ContainerDied","Data":"5dcfb6af57200a205adb54a7811dc65869766ca39a519254648d00ee7b7cf1e3"}
Aug 04 10:05:17.036528 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.036342    2554 scope.go:117] "RemoveContainer" containerID="bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7"
Aug 04 10:05:17.047605 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.047586    2554 scope.go:117] "RemoveContainer" containerID="bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7"
Aug 04 10:05:17.047909 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:05:17.047891    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7\": container with ID starting with bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7 not found: ID does not exist" containerID="bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7"
Aug 04 10:05:17.047960 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.047918    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7"} err="failed to get container status \"bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7\": rpc error: code = NotFound desc = could not find container \"bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7\": container with ID starting with bea96bbdddaa1c69c9465c3d2d28b27d2894f99c9510f16cc9a823583c07d4d7 not found: ID does not exist"
Aug 04 10:05:17.064852 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.064823    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"]
Aug 04 10:05:17.068089 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.068066    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fc7b93-5949655ddb-frcln"]
Aug 04 10:05:17.101487 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.101447    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45d6613c-bac0-4d9a-be03-50352acad665-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:17.101487 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.101485    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shlct\" (UniqueName: \"kubernetes.io/projected/45d6613c-bac0-4d9a-be03-50352acad665-kube-api-access-shlct\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:17.101701 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:17.101498    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45d6613c-bac0-4d9a-be03-50352acad665-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:18.784250 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:18.784212    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a4495ac-7659-469f-b028-9266c8b1fc0f" path="/var/lib/kubelet/pods/3a4495ac-7659-469f-b028-9266c8b1fc0f/volumes"
Aug 04 10:05:18.784753 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:18.784651    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d6613c-bac0-4d9a-be03-50352acad665" path="/var/lib/kubelet/pods/45d6613c-bac0-4d9a-be03-50352acad665/volumes"
Aug 04 10:05:22.317875 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:22.317831    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"]
Aug 04 10:05:37.338251 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.338208    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq" podUID="9239d274-6382-415d-b28a-6029ce927fa8" containerName="main" containerID="cri-o://19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae" gracePeriod=45
Aug 04 10:05:37.484075 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.484029    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq" podUID="9239d274-6382-415d-b28a-6029ce927fa8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.59:8000/ready\": dial tcp 10.132.0.59:8000: connect: connection refused"
Aug 04 10:05:37.588190 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.588160    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:05:37.700256 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700154    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s75jd\" (UniqueName: \"kubernetes.io/projected/9239d274-6382-415d-b28a-6029ce927fa8-kube-api-access-s75jd\") pod \"9239d274-6382-415d-b28a-6029ce927fa8\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") "
Aug 04 10:05:37.700256 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700232    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-model-cache\") pod \"9239d274-6382-415d-b28a-6029ce927fa8\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") "
Aug 04 10:05:37.700537 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700279    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-tmp-dir\") pod \"9239d274-6382-415d-b28a-6029ce927fa8\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") "
Aug 04 10:05:37.700537 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700314    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-home\") pod \"9239d274-6382-415d-b28a-6029ce927fa8\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") "
Aug 04 10:05:37.700537 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700348    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-dshm\") pod \"9239d274-6382-415d-b28a-6029ce927fa8\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") "
Aug 04 10:05:37.700537 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700432    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9239d274-6382-415d-b28a-6029ce927fa8-tls-certs\") pod \"9239d274-6382-415d-b28a-6029ce927fa8\" (UID: \"9239d274-6382-415d-b28a-6029ce927fa8\") "
Aug 04 10:05:37.700741 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700559    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9239d274-6382-415d-b28a-6029ce927fa8" (UID: "9239d274-6382-415d-b28a-6029ce927fa8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:05:37.700741 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700576    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-model-cache" (OuterVolumeSpecName: "model-cache") pod "9239d274-6382-415d-b28a-6029ce927fa8" (UID: "9239d274-6382-415d-b28a-6029ce927fa8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:05:37.700741 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700631    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-home" (OuterVolumeSpecName: "home") pod "9239d274-6382-415d-b28a-6029ce927fa8" (UID: "9239d274-6382-415d-b28a-6029ce927fa8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:05:37.700898 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700804    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-model-cache\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:37.700898 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700818    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-tmp-dir\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:37.700898 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.700827    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-home\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:37.702771 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.702731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-dshm" (OuterVolumeSpecName: "dshm") pod "9239d274-6382-415d-b28a-6029ce927fa8" (UID: "9239d274-6382-415d-b28a-6029ce927fa8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:05:37.702903 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.702773    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9239d274-6382-415d-b28a-6029ce927fa8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9239d274-6382-415d-b28a-6029ce927fa8" (UID: "9239d274-6382-415d-b28a-6029ce927fa8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:05:37.702903 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.702850    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9239d274-6382-415d-b28a-6029ce927fa8-kube-api-access-s75jd" (OuterVolumeSpecName: "kube-api-access-s75jd") pod "9239d274-6382-415d-b28a-6029ce927fa8" (UID: "9239d274-6382-415d-b28a-6029ce927fa8"). InnerVolumeSpecName "kube-api-access-s75jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:05:37.802014 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.801982    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9239d274-6382-415d-b28a-6029ce927fa8-dshm\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:37.802014 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.802008    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9239d274-6382-415d-b28a-6029ce927fa8-tls-certs\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:37.802014 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:37.802020    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s75jd\" (UniqueName: \"kubernetes.io/projected/9239d274-6382-415d-b28a-6029ce927fa8-kube-api-access-s75jd\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:05:38.143296 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.143258    2554 generic.go:356] "Generic (PLEG): container finished" podID="9239d274-6382-415d-b28a-6029ce927fa8" containerID="19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae" exitCode=0
Aug 04 10:05:38.143506 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.143306    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"
Aug 04 10:05:38.143506 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.143317    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq" event={"ID":"9239d274-6382-415d-b28a-6029ce927fa8","Type":"ContainerDied","Data":"19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae"}
Aug 04 10:05:38.143506 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.143348    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq" event={"ID":"9239d274-6382-415d-b28a-6029ce927fa8","Type":"ContainerDied","Data":"d67c155b4ae9910bd4f6ffdc20e1ff933c4001a29eff29a92442ec7c8c3309d9"}
Aug 04 10:05:38.143506 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.143364    2554 scope.go:117] "RemoveContainer" containerID="19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae"
Aug 04 10:05:38.152681 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.152660    2554 scope.go:117] "RemoveContainer" containerID="19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae"
Aug 04 10:05:38.152946 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:05:38.152926    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae\": container with ID starting with 19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae not found: ID does not exist" containerID="19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae"
Aug 04 10:05:38.152996 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.152958    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae"} err="failed to get container status \"19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae\": rpc error: code = NotFound desc = could not find container \"19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae\": container with ID starting with 19ad780e4502a891c58ef0fddc52f02fd0e37c461646c726abe726b684e100ae not found: ID does not exist"
Aug 04 10:05:38.169318 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.169288    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"]
Aug 04 10:05:38.171016 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.170996    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-fc7b93/ipp-route-fc7b93-kserve-7777f69f67-bkphq"]
Aug 04 10:05:38.781941 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:05:38.781896    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9239d274-6382-415d-b28a-6029ce927fa8" path="/var/lib/kubelet/pods/9239d274-6382-415d-b28a-6029ce927fa8/volumes"
Aug 04 10:06:17.884139 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:17.884097    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"]
Aug 04 10:06:17.884770 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:17.884353    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs" podUID="23be8ac9-4521-4f93-90fb-a6c98a4e1992" containerName="maas-api" containerID="cri-o://97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2" gracePeriod=30
Aug 04 10:06:18.142997 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.142935    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:06:18.238326 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.238295    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wctnl\" (UniqueName: \"kubernetes.io/projected/23be8ac9-4521-4f93-90fb-a6c98a4e1992-kube-api-access-wctnl\") pod \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") "
Aug 04 10:06:18.238522 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.238334    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls\") pod \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") "
Aug 04 10:06:18.238522 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.238367    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23be8ac9-4521-4f93-90fb-a6c98a4e1992-openshift-service-ca\") pod \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\" (UID: \"23be8ac9-4521-4f93-90fb-a6c98a4e1992\") "
Aug 04 10:06:18.238770 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.238738    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23be8ac9-4521-4f93-90fb-a6c98a4e1992-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23be8ac9-4521-4f93-90fb-a6c98a4e1992" (UID: "23be8ac9-4521-4f93-90fb-a6c98a4e1992"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:06:18.240571 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.240547    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23be8ac9-4521-4f93-90fb-a6c98a4e1992-kube-api-access-wctnl" (OuterVolumeSpecName: "kube-api-access-wctnl") pod "23be8ac9-4521-4f93-90fb-a6c98a4e1992" (UID: "23be8ac9-4521-4f93-90fb-a6c98a4e1992"). InnerVolumeSpecName "kube-api-access-wctnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:06:18.240676 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.240655    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23be8ac9-4521-4f93-90fb-a6c98a4e1992" (UID: "23be8ac9-4521-4f93-90fb-a6c98a4e1992"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:06:18.339162 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.339132    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wctnl\" (UniqueName: \"kubernetes.io/projected/23be8ac9-4521-4f93-90fb-a6c98a4e1992-kube-api-access-wctnl\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:18.339162 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.339159    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23be8ac9-4521-4f93-90fb-a6c98a4e1992-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:18.339162 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.339168    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23be8ac9-4521-4f93-90fb-a6c98a4e1992-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:18.343089 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.343062    2554 generic.go:356] "Generic (PLEG): container finished" podID="23be8ac9-4521-4f93-90fb-a6c98a4e1992" containerID="97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2" exitCode=0
Aug 04 10:06:18.343209 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.343108    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"
Aug 04 10:06:18.343209 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.343123    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs" event={"ID":"23be8ac9-4521-4f93-90fb-a6c98a4e1992","Type":"ContainerDied","Data":"97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2"}
Aug 04 10:06:18.343209 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.343164    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs" event={"ID":"23be8ac9-4521-4f93-90fb-a6c98a4e1992","Type":"ContainerDied","Data":"88deb289b10651c6a74bef5cd916cdd9c133011d4b84b9d9afc02c56a1be5391"}
Aug 04 10:06:18.343209 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.343185    2554 scope.go:117] "RemoveContainer" containerID="97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2"
Aug 04 10:06:18.352873 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.352852    2554 scope.go:117] "RemoveContainer" containerID="97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2"
Aug 04 10:06:18.353125 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:06:18.353107    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2\": container with ID starting with 97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2 not found: ID does not exist" containerID="97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2"
Aug 04 10:06:18.353198 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.353139    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2"} err="failed to get container status \"97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2\": rpc error: code = NotFound desc = could not find container \"97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2\": container with ID starting with 97ee39fc49cfcc63c3fc836b1fbeb64472b299d1c82b9b01c06d8cb6cd9988a2 not found: ID does not exist"
Aug 04 10:06:18.366533 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.366507    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"]
Aug 04 10:06:18.371746 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.371719    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-90d908-7dc788f4bf-mz6zs"]
Aug 04 10:06:18.781443 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:18.781408    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23be8ac9-4521-4f93-90fb-a6c98a4e1992" path="/var/lib/kubelet/pods/23be8ac9-4521-4f93-90fb-a6c98a4e1992/volumes"
Aug 04 10:06:25.137258 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137224    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"]
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137588    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9239d274-6382-415d-b28a-6029ce927fa8" containerName="main"
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137599    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9239d274-6382-415d-b28a-6029ce927fa8" containerName="main"
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137616    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4495ac-7659-469f-b028-9266c8b1fc0f" containerName="revoke-keys"
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137623    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4495ac-7659-469f-b028-9266c8b1fc0f" containerName="revoke-keys"
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137634    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23be8ac9-4521-4f93-90fb-a6c98a4e1992" containerName="maas-api"
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137640    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="23be8ac9-4521-4f93-90fb-a6c98a4e1992" containerName="maas-api"
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137647    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d6613c-bac0-4d9a-be03-50352acad665" containerName="maas-api"
Aug 04 10:06:25.137664 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137652    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d6613c-bac0-4d9a-be03-50352acad665" containerName="maas-api"
Aug 04 10:06:25.137923 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137712    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="23be8ac9-4521-4f93-90fb-a6c98a4e1992" containerName="maas-api"
Aug 04 10:06:25.137923 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137718    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9239d274-6382-415d-b28a-6029ce927fa8" containerName="main"
Aug 04 10:06:25.137923 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137726    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d6613c-bac0-4d9a-be03-50352acad665" containerName="maas-api"
Aug 04 10:06:25.137923 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.137731    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a4495ac-7659-469f-b028-9266c8b1fc0f" containerName="revoke-keys"
Aug 04 10:06:25.142136 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.142119    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"
Aug 04 10:06:25.146250 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.146222    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ftr4r\""
Aug 04 10:06:25.153790 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.153763    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"]
Aug 04 10:06:25.304339 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.304299    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35a8ce9-fc2f-4031-877b-d064f2218e2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-497679-tkrj6\" (UID: \"c35a8ce9-fc2f-4031-877b-d064f2218e2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"
Aug 04 10:06:25.405442 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.405353    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35a8ce9-fc2f-4031-877b-d064f2218e2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-497679-tkrj6\" (UID: \"c35a8ce9-fc2f-4031-877b-d064f2218e2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"
Aug 04 10:06:25.406010 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.405988    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35a8ce9-fc2f-4031-877b-d064f2218e2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-497679-tkrj6\" (UID: \"c35a8ce9-fc2f-4031-877b-d064f2218e2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"
Aug 04 10:06:25.453993 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.453964    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"
Aug 04 10:06:25.598648 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:25.598597    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"]
Aug 04 10:06:25.601039 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:06:25.601012    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35a8ce9_fc2f_4031_877b_d064f2218e2b.slice/crio-91236cad2f8f3e52e4ad4877e89884cd2e5b9416830751e41fdfc8997a4ef2ed WatchSource:0}: Error finding container 91236cad2f8f3e52e4ad4877e89884cd2e5b9416830751e41fdfc8997a4ef2ed: Status 404 returned error can't find the container with id 91236cad2f8f3e52e4ad4877e89884cd2e5b9416830751e41fdfc8997a4ef2ed
Aug 04 10:06:26.389321 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:26.389284    2554 generic.go:356] "Generic (PLEG): container finished" podID="c35a8ce9-fc2f-4031-877b-d064f2218e2b" containerID="a98863ef1a0af31b31972fbe9755c72e6ba4f1aa7e40110cfdf32f1c7510af1e" exitCode=0
Aug 04 10:06:26.389764 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:26.389370    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6" event={"ID":"c35a8ce9-fc2f-4031-877b-d064f2218e2b","Type":"ContainerDied","Data":"a98863ef1a0af31b31972fbe9755c72e6ba4f1aa7e40110cfdf32f1c7510af1e"}
Aug 04 10:06:26.389764 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:26.389436    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6" event={"ID":"c35a8ce9-fc2f-4031-877b-d064f2218e2b","Type":"ContainerStarted","Data":"91236cad2f8f3e52e4ad4877e89884cd2e5b9416830751e41fdfc8997a4ef2ed"}
Aug 04 10:06:27.532543 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:27.532512    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"
Aug 04 10:06:27.624326 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:27.624291    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35a8ce9-fc2f-4031-877b-d064f2218e2b-maas-api-service-ca\") pod \"c35a8ce9-fc2f-4031-877b-d064f2218e2b\" (UID: \"c35a8ce9-fc2f-4031-877b-d064f2218e2b\") "
Aug 04 10:06:27.624695 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:27.624676    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35a8ce9-fc2f-4031-877b-d064f2218e2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c35a8ce9-fc2f-4031-877b-d064f2218e2b" (UID: "c35a8ce9-fc2f-4031-877b-d064f2218e2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:06:27.725432 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:27.725353    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35a8ce9-fc2f-4031-877b-d064f2218e2b-maas-api-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:28.400387 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:28.400349    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"
Aug 04 10:06:28.400570 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:28.400389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6" event={"ID":"c35a8ce9-fc2f-4031-877b-d064f2218e2b","Type":"ContainerDied","Data":"91236cad2f8f3e52e4ad4877e89884cd2e5b9416830751e41fdfc8997a4ef2ed"}
Aug 04 10:06:28.400570 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:28.400435    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91236cad2f8f3e52e4ad4877e89884cd2e5b9416830751e41fdfc8997a4ef2ed"
Aug 04 10:06:35.706042 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.706004    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"]
Aug 04 10:06:35.706537 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.706356    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v" podUID="80c02aba-5e92-4cf7-b190-8e582e1c604a" containerName="maas-api" containerID="cri-o://608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269" gracePeriod=30
Aug 04 10:06:35.737748 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.737717    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"]
Aug 04 10:06:35.739906 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.739883    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-497679-29763960-fz8k4"]
Aug 04 10:06:35.947804 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.947775    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"]
Aug 04 10:06:35.951151 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.951128    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-497679-tkrj6"]
Aug 04 10:06:35.964471 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.964396    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 10:06:35.997556 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.997527    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c02aba-5e92-4cf7-b190-8e582e1c604a-openshift-service-ca\") pod \"80c02aba-5e92-4cf7-b190-8e582e1c604a\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") "
Aug 04 10:06:35.997709 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.997634    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls\") pod \"80c02aba-5e92-4cf7-b190-8e582e1c604a\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") "
Aug 04 10:06:35.997709 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.997657    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf78x\" (UniqueName: \"kubernetes.io/projected/80c02aba-5e92-4cf7-b190-8e582e1c604a-kube-api-access-tf78x\") pod \"80c02aba-5e92-4cf7-b190-8e582e1c604a\" (UID: \"80c02aba-5e92-4cf7-b190-8e582e1c604a\") "
Aug 04 10:06:35.997922 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.997899    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c02aba-5e92-4cf7-b190-8e582e1c604a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80c02aba-5e92-4cf7-b190-8e582e1c604a" (UID: "80c02aba-5e92-4cf7-b190-8e582e1c604a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:06:35.999901 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.999869    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80c02aba-5e92-4cf7-b190-8e582e1c604a" (UID: "80c02aba-5e92-4cf7-b190-8e582e1c604a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:06:36.000001 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:35.999971    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c02aba-5e92-4cf7-b190-8e582e1c604a-kube-api-access-tf78x" (OuterVolumeSpecName: "kube-api-access-tf78x") pod "80c02aba-5e92-4cf7-b190-8e582e1c604a" (UID: "80c02aba-5e92-4cf7-b190-8e582e1c604a"). InnerVolumeSpecName "kube-api-access-tf78x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:06:36.098928 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.098893    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c02aba-5e92-4cf7-b190-8e582e1c604a-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:36.098928 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.098922    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c02aba-5e92-4cf7-b190-8e582e1c604a-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:36.098928 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.098932    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf78x\" (UniqueName: \"kubernetes.io/projected/80c02aba-5e92-4cf7-b190-8e582e1c604a-kube-api-access-tf78x\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:36.442639 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.442602    2554 generic.go:356] "Generic (PLEG): container finished" podID="80c02aba-5e92-4cf7-b190-8e582e1c604a" containerID="608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269" exitCode=0
Aug 04 10:06:36.442639 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.442648    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"
Aug 04 10:06:36.442871 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.442689    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v" event={"ID":"80c02aba-5e92-4cf7-b190-8e582e1c604a","Type":"ContainerDied","Data":"608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269"}
Aug 04 10:06:36.442871 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.442742    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v" event={"ID":"80c02aba-5e92-4cf7-b190-8e582e1c604a","Type":"ContainerDied","Data":"698d2767e6491fc761053798e8688d8368a9a85b47cf5e780e44e33a96fd405b"}
Aug 04 10:06:36.442871 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.442766    2554 scope.go:117] "RemoveContainer" containerID="608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269"
Aug 04 10:06:36.452033 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.452016    2554 scope.go:117] "RemoveContainer" containerID="608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269"
Aug 04 10:06:36.452301 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:06:36.452282    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269\": container with ID starting with 608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269 not found: ID does not exist" containerID="608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269"
Aug 04 10:06:36.452350 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.452313    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269"} err="failed to get container status \"608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269\": rpc error: code = NotFound desc = could not find container \"608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269\": container with ID starting with 608b2ae4a2a3387de983b0949e13f0c3735331393d3342363d607d15c06b1269 not found: ID does not exist"
Aug 04 10:06:36.470216 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.470187    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"]
Aug 04 10:06:36.471799 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.471782    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-497679-576ff695f6-xvh4v"]
Aug 04 10:06:36.782371 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.782297    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c02aba-5e92-4cf7-b190-8e582e1c604a" path="/var/lib/kubelet/pods/80c02aba-5e92-4cf7-b190-8e582e1c604a/volumes"
Aug 04 10:06:36.782763 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.782639    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35a8ce9-fc2f-4031-877b-d064f2218e2b" path="/var/lib/kubelet/pods/c35a8ce9-fc2f-4031-877b-d064f2218e2b/volumes"
Aug 04 10:06:36.782893 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:36.782878    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb49a0d0-8fed-4e13-8be6-c58bbc3d7944" path="/var/lib/kubelet/pods/cb49a0d0-8fed-4e13-8be6-c58bbc3d7944/volumes"
Aug 04 10:06:43.368340 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.368303    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"]
Aug 04 10:06:43.368762 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.368671    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c02aba-5e92-4cf7-b190-8e582e1c604a" containerName="maas-api"
Aug 04 10:06:43.368762 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.368683    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c02aba-5e92-4cf7-b190-8e582e1c604a" containerName="maas-api"
Aug 04 10:06:43.368762 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.368702    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35a8ce9-fc2f-4031-877b-d064f2218e2b" containerName="revoke-keys"
Aug 04 10:06:43.368762 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.368708    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35a8ce9-fc2f-4031-877b-d064f2218e2b" containerName="revoke-keys"
Aug 04 10:06:43.368894 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.368765    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c02aba-5e92-4cf7-b190-8e582e1c604a" containerName="maas-api"
Aug 04 10:06:43.368894 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.368777    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35a8ce9-fc2f-4031-877b-d064f2218e2b" containerName="revoke-keys"
Aug 04 10:06:43.373075 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.373050    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"
Aug 04 10:06:43.376896 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.376870    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ftr4r\""
Aug 04 10:06:43.382337 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.382020    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"]
Aug 04 10:06:43.458376 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.458341    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0c611c-0578-42bb-b045-d5f56fccbcc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb\" (UID: \"fa0c611c-0578-42bb-b045-d5f56fccbcc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"
Aug 04 10:06:43.559163 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.559132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0c611c-0578-42bb-b045-d5f56fccbcc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb\" (UID: \"fa0c611c-0578-42bb-b045-d5f56fccbcc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"
Aug 04 10:06:43.559801 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.559778    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0c611c-0578-42bb-b045-d5f56fccbcc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb\" (UID: \"fa0c611c-0578-42bb-b045-d5f56fccbcc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"
Aug 04 10:06:43.687220 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.687137    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"
Aug 04 10:06:43.832070 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:43.832042    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"]
Aug 04 10:06:43.833718 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:06:43.833683    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0c611c_0578_42bb_b045_d5f56fccbcc4.slice/crio-9b70c58d2c9800fd0e66ade61bc658affa07bf5036604fa2482393d77e9096d1 WatchSource:0}: Error finding container 9b70c58d2c9800fd0e66ade61bc658affa07bf5036604fa2482393d77e9096d1: Status 404 returned error can't find the container with id 9b70c58d2c9800fd0e66ade61bc658affa07bf5036604fa2482393d77e9096d1
Aug 04 10:06:44.486114 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:44.486084    2554 generic.go:356] "Generic (PLEG): container finished" podID="fa0c611c-0578-42bb-b045-d5f56fccbcc4" containerID="3eb16b674501f34fa4778b3ceadb945a429301d3ba2f095a8a6c8ccbe31666b8" exitCode=0
Aug 04 10:06:44.486500 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:44.486172    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb" event={"ID":"fa0c611c-0578-42bb-b045-d5f56fccbcc4","Type":"ContainerDied","Data":"3eb16b674501f34fa4778b3ceadb945a429301d3ba2f095a8a6c8ccbe31666b8"}
Aug 04 10:06:44.486500 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:44.486248    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb" event={"ID":"fa0c611c-0578-42bb-b045-d5f56fccbcc4","Type":"ContainerStarted","Data":"9b70c58d2c9800fd0e66ade61bc658affa07bf5036604fa2482393d77e9096d1"}
Aug 04 10:06:45.629284 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:45.629253    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"
Aug 04 10:06:45.676860 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:45.676826    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0c611c-0578-42bb-b045-d5f56fccbcc4-maas-api-service-ca\") pod \"fa0c611c-0578-42bb-b045-d5f56fccbcc4\" (UID: \"fa0c611c-0578-42bb-b045-d5f56fccbcc4\") "
Aug 04 10:06:45.677262 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:45.677234    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa0c611c-0578-42bb-b045-d5f56fccbcc4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fa0c611c-0578-42bb-b045-d5f56fccbcc4" (UID: "fa0c611c-0578-42bb-b045-d5f56fccbcc4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:06:45.777565 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:45.777484    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0c611c-0578-42bb-b045-d5f56fccbcc4-maas-api-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:46.498448 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:46.498416    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"
Aug 04 10:06:46.498448 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:46.498424    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb" event={"ID":"fa0c611c-0578-42bb-b045-d5f56fccbcc4","Type":"ContainerDied","Data":"9b70c58d2c9800fd0e66ade61bc658affa07bf5036604fa2482393d77e9096d1"}
Aug 04 10:06:46.498662 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:46.498495    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b70c58d2c9800fd0e66ade61bc658affa07bf5036604fa2482393d77e9096d1"
Aug 04 10:06:53.889196 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:53.889163    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"]
Aug 04 10:06:53.889771 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:53.889359    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x" podUID="6ca255be-ccf6-4603-92f5-589e2014bd63" containerName="maas-api" containerID="cri-o://8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10" gracePeriod=30
Aug 04 10:06:53.935426 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:53.935394    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"]
Aug 04 10:06:53.941089 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:53.941063    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b0bc81-29763960-qlh97"]
Aug 04 10:06:54.145768 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.145694    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 10:06:54.148901 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.148873    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"]
Aug 04 10:06:54.156526 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.156496    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b0bc81-9bspb"]
Aug 04 10:06:54.251682 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.251651    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls\") pod \"6ca255be-ccf6-4603-92f5-589e2014bd63\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") "
Aug 04 10:06:54.251857 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.251697    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca255be-ccf6-4603-92f5-589e2014bd63-openshift-service-ca\") pod \"6ca255be-ccf6-4603-92f5-589e2014bd63\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") "
Aug 04 10:06:54.251857 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.251758    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkhrq\" (UniqueName: \"kubernetes.io/projected/6ca255be-ccf6-4603-92f5-589e2014bd63-kube-api-access-gkhrq\") pod \"6ca255be-ccf6-4603-92f5-589e2014bd63\" (UID: \"6ca255be-ccf6-4603-92f5-589e2014bd63\") "
Aug 04 10:06:54.252112 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.252080    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ca255be-ccf6-4603-92f5-589e2014bd63-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ca255be-ccf6-4603-92f5-589e2014bd63" (UID: "6ca255be-ccf6-4603-92f5-589e2014bd63"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:06:54.254117 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.254081    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ca255be-ccf6-4603-92f5-589e2014bd63" (UID: "6ca255be-ccf6-4603-92f5-589e2014bd63"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:06:54.254117 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.254110    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ca255be-ccf6-4603-92f5-589e2014bd63-kube-api-access-gkhrq" (OuterVolumeSpecName: "kube-api-access-gkhrq") pod "6ca255be-ccf6-4603-92f5-589e2014bd63" (UID: "6ca255be-ccf6-4603-92f5-589e2014bd63"). InnerVolumeSpecName "kube-api-access-gkhrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:06:54.352942 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.352901    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca255be-ccf6-4603-92f5-589e2014bd63-maas-api-tls\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:54.352942 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.352931    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca255be-ccf6-4603-92f5-589e2014bd63-openshift-service-ca\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:54.353149 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.352963    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkhrq\" (UniqueName: \"kubernetes.io/projected/6ca255be-ccf6-4603-92f5-589e2014bd63-kube-api-access-gkhrq\") on node \"ip-10-0-143-202.ec2.internal\" DevicePath \"\""
Aug 04 10:06:54.540146 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.540046    2554 generic.go:356] "Generic (PLEG): container finished" podID="6ca255be-ccf6-4603-92f5-589e2014bd63" containerID="8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10" exitCode=0
Aug 04 10:06:54.540146 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.540084    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x" event={"ID":"6ca255be-ccf6-4603-92f5-589e2014bd63","Type":"ContainerDied","Data":"8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10"}
Aug 04 10:06:54.540146 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.540100    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"
Aug 04 10:06:54.540146 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.540121    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x" event={"ID":"6ca255be-ccf6-4603-92f5-589e2014bd63","Type":"ContainerDied","Data":"702e29dfd2186725d0dc0388502ba1a0ade1ad9a33e22a05456fbf17218663d0"}
Aug 04 10:06:54.540146 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.540145    2554 scope.go:117] "RemoveContainer" containerID="8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10"
Aug 04 10:06:54.549630 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.549608    2554 scope.go:117] "RemoveContainer" containerID="8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10"
Aug 04 10:06:54.552633 ip-10-0-143-202 kubenswrapper[2554]: E0804 10:06:54.552601    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10\": container with ID starting with 8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10 not found: ID does not exist" containerID="8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10"
Aug 04 10:06:54.552740 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.552643    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10"} err="failed to get container status \"8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10\": rpc error: code = NotFound desc = could not find container \"8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10\": container with ID starting with 8b0cbc4a788406a77aff506334852e31d37c76dcd37bae13bc927fdfffbd6d10 not found: ID does not exist"
Aug 04 10:06:54.573644 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.573611    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"]
Aug 04 10:06:54.580388 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.580361    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0bc81-9757c9cb7-2lf7x"]
Aug 04 10:06:54.781202 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.781169    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="060123a5-880a-4742-ab42-5db39ec3b6f1" path="/var/lib/kubelet/pods/060123a5-880a-4742-ab42-5db39ec3b6f1/volumes"
Aug 04 10:06:54.781566 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.781552    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ca255be-ccf6-4603-92f5-589e2014bd63" path="/var/lib/kubelet/pods/6ca255be-ccf6-4603-92f5-589e2014bd63/volumes"
Aug 04 10:06:54.781842 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:06:54.781830    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa0c611c-0578-42bb-b045-d5f56fccbcc4" path="/var/lib/kubelet/pods/fa0c611c-0578-42bb-b045-d5f56fccbcc4/volumes"
Aug 04 10:07:07.567820 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:07.567791    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c7w2s_2250e805-e385-42ce-bfe8-6c551571621e/manager/0.log"
Aug 04 10:07:07.697643 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:07.697609    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8fr7q_b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2/manager/0.log"
Aug 04 10:07:08.320515 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:08.320486    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c79dd6bb-crkj4_259b2b93-fabd-4dde-879c-265bb31963fa/copy-manifests/0.log"
Aug 04 10:07:08.328068 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:08.328045    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c79dd6bb-crkj4_259b2b93-fabd-4dde-879c-265bb31963fa/manager/0.log"
Aug 04 10:07:08.828016 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:08.827977    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b95dff94b-zxsc4_d24ca4b8-1f6e-4d63-a93c-1f4eb0daf082/maas-api/0.log"
Aug 04 10:07:10.459592 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:10.459565    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-7l78s_50337210-396a-4194-bc0e-caf42c36629e/kuadrant-console-plugin/0.log"
Aug 04 10:07:10.588977 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:10.588948    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-z6w84_0bf63b74-5384-42dc-abbb-32f73ef9ac78/manager/0.log"
Aug 04 10:07:11.976433 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:11.976400    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7f49d6c4-92bh4_224cdd14-b33f-4cbb-a3e5-252e312cc879/router/0.log"
Aug 04 10:07:12.342033 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:12.341997    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tzw5g_945da735-2c75-4b30-839a-89d4982f7527/main/0.log"
Aug 04 10:07:12.591301 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:12.591266    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-wxqfb_ff0755fe-3234-4d05-bd1d-01d409df383e/main/0.log"
Aug 04 10:07:12.829153 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:12.829124    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-62gbm_c085fd33-072c-4fee-b5f6-50a2bc8b817b/main/0.log"
Aug 04 10:07:21.732000 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:21.731921    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5whhp_cbcb9552-fcb4-4a61-8686-311e5c65e2a3/global-pull-secret-syncer/0.log"
Aug 04 10:07:21.978587 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:21.978557    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pr9wb_f875b2cd-646a-4128-b58a-8f11599cd89a/konnectivity-agent/0.log"
Aug 04 10:07:22.058436 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:22.058407    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-202.ec2.internal_2e45daf01c7ddea46a25573911e9f0bc/haproxy/0.log"
Aug 04 10:07:26.879684 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:26.879654    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-7l78s_50337210-396a-4194-bc0e-caf42c36629e/kuadrant-console-plugin/0.log"
Aug 04 10:07:27.004187 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:27.004151    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-z6w84_0bf63b74-5384-42dc-abbb-32f73ef9ac78/manager/0.log"
Aug 04 10:07:28.686564 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:28.686522    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/1.log"
Aug 04 10:07:28.841575 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:28.841544    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 10:07:29.258253 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:29.258222    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwzfn_1a03503f-866a-45fd-ab65-591c492bfbc2/node-exporter/0.log"
Aug 04 10:07:29.302329 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:29.302304    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwzfn_1a03503f-866a-45fd-ab65-591c492bfbc2/kube-rbac-proxy/0.log"
Aug 04 10:07:29.326396 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:29.326371    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwzfn_1a03503f-866a-45fd-ab65-591c492bfbc2/init-textfile/0.log"
Aug 04 10:07:31.007652 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.007545    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 10:07:31.015834 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.012138    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-jnr8f_d592a7b2-418a-412c-8632-e5c4fb4584e9/cluster-monitoring-operator/0.log"
Aug 04 10:07:31.015834 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.015021    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 10:07:31.019628 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.019604    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 10:07:31.197363 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.197328    2554 scope.go:117] "RemoveContainer" containerID="2edbe0a2ead5695e5036b3c31e4f548173ae7623856553d0758a82d161a5d3ff"
Aug 04 10:07:31.199444 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.199423    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-56shw_b7fb4639-25ba-4de9-a479-50e30ff21bb5/networking-console-plugin/0.log"
Aug 04 10:07:31.206392 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.206372    2554 scope.go:117] "RemoveContainer" containerID="f2ed22427d52582b60d1194d7124181127d380f450e162d8ada6aecbd4b65fac"
Aug 04 10:07:31.535155 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.535119    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"]
Aug 04 10:07:31.535569 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.535556    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0c611c-0578-42bb-b045-d5f56fccbcc4" containerName="revoke-keys"
Aug 04 10:07:31.535649 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.535571    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0c611c-0578-42bb-b045-d5f56fccbcc4" containerName="revoke-keys"
Aug 04 10:07:31.535649 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.535595    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ca255be-ccf6-4603-92f5-589e2014bd63" containerName="maas-api"
Aug 04 10:07:31.535649 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.535602    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ca255be-ccf6-4603-92f5-589e2014bd63" containerName="maas-api"
Aug 04 10:07:31.535749 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.535662    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ca255be-ccf6-4603-92f5-589e2014bd63" containerName="maas-api"
Aug 04 10:07:31.535749 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.535678    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa0c611c-0578-42bb-b045-d5f56fccbcc4" containerName="revoke-keys"
Aug 04 10:07:31.540338 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.540318    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.543521 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.543497    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ddhlv\"/\"openshift-service-ca.crt\""
Aug 04 10:07:31.543643 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.543499    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ddhlv\"/\"default-dockercfg-lb999\""
Aug 04 10:07:31.544585 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.544570    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ddhlv\"/\"kube-root-ca.crt\""
Aug 04 10:07:31.551013 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.550988    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"]
Aug 04 10:07:31.575736 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.575707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-lib-modules\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.575874 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.575746    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mkdj\" (UniqueName: \"kubernetes.io/projected/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-kube-api-access-7mkdj\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.575874 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.575767    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-proc\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.575874 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.575832    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-sys\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.575975 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.575877    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-podres\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676261 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676237    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-lib-modules\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676425 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676270    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mkdj\" (UniqueName: \"kubernetes.io/projected/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-kube-api-access-7mkdj\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676425 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676292    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-proc\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676425 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676329    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-sys\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676425 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-podres\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676425 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676417    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-lib-modules\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676741 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676419    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-proc\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676741 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676511    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-sys\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.676741 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.676539    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-podres\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.690597 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.690575    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mkdj\" (UniqueName: \"kubernetes.io/projected/36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0-kube-api-access-7mkdj\") pod \"perf-node-gather-daemonset-j9hx6\" (UID: \"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0\") " pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.850590 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.850562    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:31.909949 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.909911    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/1.log"
Aug 04 10:07:31.937989 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.937958    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-p29gj_5737b403-f4dc-47d1-b71b-894f7a414920/console-operator/2.log"
Aug 04 10:07:31.999034 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:31.998995    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"]
Aug 04 10:07:32.001629 ip-10-0-143-202 kubenswrapper[2554]: W0804 10:07:32.001599    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36f1cff3_b6f0_42fb_94eb_fb15a4a68cb0.slice/crio-1ba5188171b4033e9df6020283d9d3fba213535dc1c34b719fc3d8e9cb8e55fa WatchSource:0}: Error finding container 1ba5188171b4033e9df6020283d9d3fba213535dc1c34b719fc3d8e9cb8e55fa: Status 404 returned error can't find the container with id 1ba5188171b4033e9df6020283d9d3fba213535dc1c34b719fc3d8e9cb8e55fa
Aug 04 10:07:32.726721 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:32.726682    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6" event={"ID":"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0","Type":"ContainerStarted","Data":"b6ddb9074397730c55f46c946c74c4e62102c3fba4c3a7674f2394102e24d93c"}
Aug 04 10:07:32.727219 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:32.726739    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6" event={"ID":"36f1cff3-b6f0-42fb-94eb-fb15a4a68cb0","Type":"ContainerStarted","Data":"1ba5188171b4033e9df6020283d9d3fba213535dc1c34b719fc3d8e9cb8e55fa"}
Aug 04 10:07:32.727219 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:32.726816    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:32.745263 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:32.745191    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6" podStartSLOduration=1.7451769270000002 podStartE2EDuration="1.745176927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:07:32.745085949 +0000 UTC m=+3602.490492360" watchObservedRunningTime="2026-08-04 10:07:32.745176927 +0000 UTC m=+3602.490583337"
Aug 04 10:07:33.238477 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:33.238412    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-5nc8g_0d44f5ad-d07b-485e-8422-e74daaf5324c/volume-data-source-validator/0.log"
Aug 04 10:07:34.376398 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:34.376370    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dl7rg_357194bb-769b-4cfa-ad63-a5a88e46d580/dns/0.log"
Aug 04 10:07:34.400157 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:34.400115    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dl7rg_357194bb-769b-4cfa-ad63-a5a88e46d580/kube-rbac-proxy/0.log"
Aug 04 10:07:34.501737 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:34.501701    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p98p4_fa959971-7124-4e82-ac32-243e2d21618b/dns-node-resolver/0.log"
Aug 04 10:07:35.170270 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:35.170237    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pn5ft_ade0fdde-53c5-4073-ad65-ae5ae3755bac/node-ca/0.log"
Aug 04 10:07:36.442094 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:36.442062    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7f49d6c4-92bh4_224cdd14-b33f-4cbb-a3e5-252e312cc879/router/0.log"
Aug 04 10:07:37.304404 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:37.304367    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zn4vx_399fb17d-fe90-4391-92ea-cb891aa88f9f/serve-healthcheck-canary/0.log"
Aug 04 10:07:37.776850 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:37.776814    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rzs4h_96303cf3-7177-4101-98e9-7f7b7e13ad6f/insights-operator/0.log"
Aug 04 10:07:37.778491 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:37.778443    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rzs4h_96303cf3-7177-4101-98e9-7f7b7e13ad6f/insights-operator/1.log"
Aug 04 10:07:37.890009 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:37.889980    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dh7w2_e047cac7-feee-42b5-b9ff-94bdc83fd0b5/kube-rbac-proxy/0.log"
Aug 04 10:07:37.912671 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:37.912647    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dh7w2_e047cac7-feee-42b5-b9ff-94bdc83fd0b5/exporter/0.log"
Aug 04 10:07:37.937669 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:37.937645    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dh7w2_e047cac7-feee-42b5-b9ff-94bdc83fd0b5/extractor/0.log"
Aug 04 10:07:38.744901 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:38.744868    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ddhlv/perf-node-gather-daemonset-j9hx6"
Aug 04 10:07:40.275486 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:40.275443    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c7w2s_2250e805-e385-42ce-bfe8-6c551571621e/manager/0.log"
Aug 04 10:07:40.732578 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:40.732491    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8fr7q_b2793dc0-8aea-4c53-8dea-4fd0dd66a3a2/manager/0.log"
Aug 04 10:07:41.141980 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:41.141954    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c79dd6bb-crkj4_259b2b93-fabd-4dde-879c-265bb31963fa/manager/0.log"
Aug 04 10:07:41.169169 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:41.169138    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c79dd6bb-crkj4_259b2b93-fabd-4dde-879c-265bb31963fa/copy-manifests/0.log"
Aug 04 10:07:42.418194 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:42.418163    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7f49d6c4-92bh4_224cdd14-b33f-4cbb-a3e5-252e312cc879/router/0.log"
Aug 04 10:07:42.612100 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:42.612066    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8856bf979-kgczp_c3c4d415-053b-461a-95c2-b7e6f7c3992e/manager/0.log"
Aug 04 10:07:44.232092 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:44.232061    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7f49d6c4-92bh4_224cdd14-b33f-4cbb-a3e5-252e312cc879/router/0.log"
Aug 04 10:07:47.713239 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:47.713209    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kb8zx_7593fd39-b53f-466d-ad27-f01841bb3b4f/migrator/0.log"
Aug 04 10:07:47.737827 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:47.737797    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kb8zx_7593fd39-b53f-466d-ad27-f01841bb3b4f/graceful-termination/0.log"
Aug 04 10:07:48.084115 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:48.084080    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-bx482_62ae4795-910a-40bd-b809-3c03901ae840/kube-storage-version-migrator-operator/1.log"
Aug 04 10:07:48.086056 ip-10-0-143-202 kubenswrapper[2554]: I0804 10:07:48.086029    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-bx482_62ae4795-910a-40bd-b809-3c03901ae840/kube-storage-version-migrator-operator/0.log"