Jul 14 16:28:01.546247 ip-10-0-141-173 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 16:28:01.546259 ip-10-0-141-173 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 16:28:01.546266 ip-10-0-141-173 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 16:28:01.546477 ip-10-0-141-173 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 16:28:11.585514 ip-10-0-141-173 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 16:28:11.585530 ip-10-0-141-173 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4136b9c5670d469bb56c01553e3b5d2f --
Jul 14 16:30:10.744032 ip-10-0-141-173 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 16:30:11.988811 ip-10-0-141-173 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:30:11.988811 ip-10-0-141-173 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 16:30:11.989336 ip-10-0-141-173 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:30:11.989336 ip-10-0-141-173 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 16:30:11.989336 ip-10-0-141-173 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:30:11.990660 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.990491    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 16:30:11.996169 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996144    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:30:11.996169 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996165    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:30:11.996169 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996170    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:30:11.996169 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996173    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:30:11.996169 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996176    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996180    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996183    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996188    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996191    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996194    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996197    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996200    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996202    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996205    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996208    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996212    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996214    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996217    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996220    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996223    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996227    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996230    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996233    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996236    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:30:11.996390 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996238    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996241    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996244    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996247    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996250    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996252    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996255    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996258    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996260    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996263    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996266    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996271    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996275    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996278    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996283    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996286    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996289    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996292    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996295    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996298    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:30:11.996899 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996301    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996303    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996306    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996309    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996312    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996315    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996318    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996321    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996324    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996326    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996330    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996334    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996337    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996340    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996343    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996346    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996349    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996352    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996355    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:30:11.997430 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996357    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996360    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996363    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996366    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996368    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996371    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996376    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996379    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996381    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996385    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996388    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996391    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996394    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996398    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996401    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996404    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996406    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996411    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996416    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996419    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:30:11.997912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996423    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996426    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996429    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996432    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996436    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996439    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996441    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996445    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996448    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996451    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996454    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996456    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996460    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996463    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996466    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.996469    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997304    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997312    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997316    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997320    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:30:11.998412 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997323    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997325    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997328    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997331    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997334    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997337    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997340    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997344    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997347    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997350    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997352    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997355    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997358    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997361    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997364    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997367    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997370    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997373    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997375    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997378    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:30:11.998963 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997381    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997384    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997387    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997390    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997393    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997396    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997399    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997401    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997404    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997409    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997414    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997417    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997420    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997423    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997425    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997428    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997431    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997434    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997437    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997440    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:30:11.999519 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997442    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997445    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997448    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997451    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997454    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997457    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997460    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997463    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997466    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997468    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997471    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997474    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997476    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997480    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997483    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997486    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997489    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997492    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997495    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997498    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:30:12.000051 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997501    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997504    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997507    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997510    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997513    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997516    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997518    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997521    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997523    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997527    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997529    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997532    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997535    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997537    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997540    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997543    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997546    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997549    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997551    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997554    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:30:12.000569 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997559    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997562    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997564    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997567    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997570    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997573    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997578    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997581    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997584    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997586    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997589    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997592    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997594    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997599    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.997603    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998048    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998054    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998058    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:30:12.001144 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998061    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998064    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998067    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998070    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998073    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998076    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998078    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998081    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998084    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998087    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998090    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998093    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998095    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998099    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998102    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998105    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998108    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998111    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998114    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998116    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:30:12.001624 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998119    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998122    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998125    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998127    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998130    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998133    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998135    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998138    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998142    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998145    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998148    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998151    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998154    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998157    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998160    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998163    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998166    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998168    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998171    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998173    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:30:12.002150 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998176    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998178    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998181    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998185    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998188    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998190    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998194    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998197    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998200    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998202    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998205    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998207    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998210    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998212    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998215    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998218    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998221    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998223    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998226    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998229    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:30:12.002733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998232    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998235    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998238    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998241    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998243    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998246    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998249    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998251    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998254    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998256    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998259    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998265    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998269    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998272    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998275    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998278    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998281    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998284    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998287    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:30:12.003266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998291    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998295    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998298    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998301    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998304    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998308    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998311    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998314    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998317    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998320    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998322    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998325    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998328    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998331    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998334    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998336    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.998339    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998415    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998423    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998430    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998435    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 16:30:12.003802 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998439    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998443    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998447    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998451    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998455    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998458    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998462    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998465    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998469    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998472    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998475    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998478    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998482    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998485    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998490    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998496    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998499    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998502    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998506    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998511    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998514    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998517    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998521    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998524    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 16:30:12.004326 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998527    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998530    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998534    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998537    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998542    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998545    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998548    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998551    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998554    2576 flags.go:64] FLAG: --enable-server="true"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998558    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998563    2576 flags.go:64] FLAG: --event-burst="100"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998566    2576 flags.go:64] FLAG: --event-qps="50"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998569    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998573    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998576    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998580    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998584    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998587    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998590    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998593    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998596    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998600    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998604    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998610    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998613    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 16:30:12.004958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998616    2576 flags.go:64] FLAG: --feature-gates=""
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998620    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998624    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998627    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998631    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998634    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998637    2576 flags.go:64] FLAG: --help="false"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998640    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998644    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998647    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998650    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998654    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998658    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998661    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998664    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998668    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998671    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998674    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998677    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998680    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998683    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998687    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998690    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998709    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 16:30:12.005608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998712    2576 flags.go:64] FLAG: --lock-file=""
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998715    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998718    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998722    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998728    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998732    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998736    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998739    2576 flags.go:64] FLAG: --logging-format="text"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998742    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998746    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998749    2576 flags.go:64] FLAG: --manifest-url=""
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998752    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998773    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998777    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998783    2576 flags.go:64] FLAG: --max-pods="110"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998786    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998790    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998793    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998797    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998801    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998804    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998807    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998815    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998819    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998823    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 16:30:12.006284 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998826    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998829    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998834    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998837    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998841    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998844    2576 flags.go:64] FLAG: --port="10250"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998847    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998851    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e9eb79f29fbf46b7"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998854    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998858    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998861    2576 flags.go:64] FLAG: --register-node="true"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998865    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998869    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998874    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998879    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998882    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998886    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998890    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998893    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998896    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998899    2576 flags.go:64] FLAG: --runonce="false"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998903    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998906    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998909    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998912    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 16:30:12.006935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998915    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998919    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998922    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998925    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998929    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998932    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998935    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998938    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998941    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998944    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998948    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998953    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998956    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998959    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998965    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998968    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998971    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998975    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998978    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998981    2576 flags.go:64] FLAG: --v="2"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998986    2576 flags.go:64] FLAG: --version="false"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998992    2576 flags.go:64] FLAG: --vmodule=""
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.998996    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.999001    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999126    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:30:12.007621 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999130    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999134    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999137    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999140    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999143    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999146    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999149    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999152    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999155    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999158    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999161    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999164    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999166    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999169    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999172    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999175    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999177    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999181    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999183    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999186    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:30:12.008271 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999188    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999191    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999194    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999197    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999199    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999202    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999205    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999207    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999212    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999216    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999222    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999226    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999229    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999232    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999235    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999238    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999241    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999244    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999246    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999249    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:30:12.008823 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999252    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999255    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999257    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999260    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999263    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999266    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999268    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999271    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999274    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999276    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999279    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999282    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999285    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999288    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999291    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999293    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999296    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999299    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999303    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:30:12.009337 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999307    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999311    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999315    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999320    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999323    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999327    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999330    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999332    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999337    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999341    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999344    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999347    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999349    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999352    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999355    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999357    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999360    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999363    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999365    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:30:12.009840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999368    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999372    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999374    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999377    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999380    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999383    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999399    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999404    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999407    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999411    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999414    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999417    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999420    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999423    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999427    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999430    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999435    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999438    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999441    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:30:12.010344 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:11.999444    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:11.999979    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.009041    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.009058    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.009882    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.009891    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009951    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009957    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009961    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009964    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009967    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009971    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009974    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009977    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:30:12.010896 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009979    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009982    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009985    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009988    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009990    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009993    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009997    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.009999    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010002    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010005    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010008    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010011    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010022    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010026    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010029    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010032    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010035    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010038    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010040    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010044    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:30:12.011266 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010047    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010051    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010055    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010058    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010061    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010064    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010067    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010072    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010076    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010079    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010082    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010085    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010088    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010091    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010094    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010097    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010100    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010103    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010106    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010110    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:30:12.011786 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010113    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010116    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010119    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010122    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010125    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010128    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010131    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010134    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010137    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010139    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010142    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010145    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010149    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010153    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010157    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010160    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010163    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010166    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010169    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:30:12.012309 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010171    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010174    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010177    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010179    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010182    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010185    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010187    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010190    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010193    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010195    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010198    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010201    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010203    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010208    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010211    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010214    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010217    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010220    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010223    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:30:12.012802 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010226    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010229    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010232    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010235    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010238    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010241    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010244    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010248    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010251    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010254    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010257    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010260    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010262    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.010268    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010390    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:30:12.013302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010397    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010400    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010403    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010405    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010408    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010411    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010414    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010417    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010420    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010422    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010425    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010428    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010431    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010433    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010436    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010439    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010442    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010446    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010450    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:30:12.013692 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010453    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010456    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010459    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010462    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010465    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010467    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010470    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010473    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010477    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010480    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010483    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010486    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010488    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010491    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010494    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010496    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010499    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010502    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010504    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:30:12.014302 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010507    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010511    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010515    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010518    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010522    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010524    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010527    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010530    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010533    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010536    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010539    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010542    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010544    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010547    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010549    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010552    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010555    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010557    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010560    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:30:12.014819 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010563    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010566    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010569    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010572    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010575    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010577    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010580    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010583    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010586    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010588    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010591    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010594    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010597    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010599    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010602    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010605    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010607    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010610    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010612    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010615    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:30:12.015307 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010618    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010621    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010623    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010627    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010629    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010632    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010635    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010637    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010640    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010642    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010645    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010648    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010651    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010654    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010656    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010659    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010667    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010670    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010673    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010675    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:30:12.015824 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:12.010678    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:30:12.016337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.010684    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:30:12.016337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.010817    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 16:30:12.016337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.012838    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 16:30:12.016337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.013948    2576 server.go:1019] "Starting client certificate rotation"
Jul 14 16:30:12.016337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.014057    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 16:30:12.016337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.014105    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 16:30:12.016337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.016286    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 16:30:12.017547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.017531    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 16:30:12.029696 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.029676    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 14 16:30:12.033882 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.033862    2576 log.go:25] "Validated CRI v1 image API"
Jul 14 16:30:12.034795 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.034777    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 16:30:12.044166 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.044147    2576 fs.go:135] Filesystem UUIDs: map[6251091b-5fa5-4250-a151-87b1d946d8fa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7c8dad64-68bf-4ca2-82b3-ddea06301cba:/dev/nvme0n1p3]
Jul 14 16:30:12.044244 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.044166    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 16:30:12.049892 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.049759    2576 manager.go:216] Machine: {Timestamp:2026-07-14 16:30:12.048470402 +0000 UTC m=+1.178454597 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104954 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d31df4a7bbfa3f1a514f1731435f4 SystemUUID:ec2d31df-4a7b-bfa3-f1a5-14f1731435f4 BootID:4136b9c5-670d-469b-b56c-01553e3b5d2f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:e5:76:3e:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:e5:76:3e:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:76:03:f1:11:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 16:30:12.049892 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.049880    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 16:30:12.050035 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.049968    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 16:30:12.052851 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.052819    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 16:30:12.052997 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.052854    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-173.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 16:30:12.054614 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.054592    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 16:30:12.058628 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.058614    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 16:30:12.058684 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.058631    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 16:30:12.058684 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.058640    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 16:30:12.058684 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.058667    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 16:30:12.059868 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.059857    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 16:30:12.063769 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.063755    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 16:30:12.063919 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.063908    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 16:30:12.063955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.063946    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 16:30:12.063984 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.063959    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 16:30:12.063984 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.063975    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 16:30:12.063984 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.063985    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 14 16:30:12.064078 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.063995    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 16:30:12.064395 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.064383    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 16:30:12.064447 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.064403    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 16:30:12.066740 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.066720    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 16:30:12.068496 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068481    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 16:30:12.068553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068515    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 16:30:12.068715 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068691    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 16:30:12.068755 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068725    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 16:30:12.068755 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068734    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 16:30:12.068755 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068740    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 16:30:12.068755 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068749    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 16:30:12.068755 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.068756    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 16:30:12.069127 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.069118    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 16:30:12.069163 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.069135    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 16:30:12.069163 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.069144    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 16:30:12.069163 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.069149    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 16:30:12.069163 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.069159    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 16:30:12.069274 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.069167    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 16:30:12.070560 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.070550    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 16:30:12.070560 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.070561    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 16:30:12.074094 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.074077    2576 server.go:1268] "Started kubelet"
Jul 14 16:30:12.074324 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.074297    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 16:30:12.074445 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.074365    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 16:30:12.074566 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.074519    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 16:30:12.075087 ip-10-0-141-173 systemd[1]: Started Kubernetes Kubelet.
Jul 14 16:30:12.075622 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.075566    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 16:30:12.075779 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.075734    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 16:30:12.083405 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.083372    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 16:30:12.083637 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.083607    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 16:30:12.083783 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.083659    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-173.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 16:30:12.083856 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.083819    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvwms"
Jul 14 16:30:12.083922 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.083742    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 16:30:12.086844 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.086000    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-173.ec2.internal.18c234f0ff69ac6f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-173.ec2.internal,UID:ip-10-0-141-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-173.ec2.internal,},FirstTimestamp:2026-07-14 16:30:12.074048623 +0000 UTC m=+1.204032877,LastTimestamp:2026-07-14 16:30:12.074048623 +0000 UTC m=+1.204032877,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-173.ec2.internal,}"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.088310    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.088312    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.088459    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089060    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089106    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089119    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089211    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089222    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089242    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089261    2576 factory.go:55] Registering systemd factory
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089271    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089485    2576 factory.go:153] Registering CRI-O factory
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089499    2576 factory.go:223] Registration of the crio container factory successfully
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089527    2576 factory.go:103] Registering Raw factory
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.089542    2576 manager.go:1196] Started watching for new ooms in manager
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.090352    2576 manager.go:349] Starting recovery of all containers
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.093643    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.093656    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.094826    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvwms"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.103648    2576 manager.go:354] Recovery completed
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.108418    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.116171    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.116203    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.116217    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.116852    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.116864    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.116881    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.116888    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.117631    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.117673    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.117688    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.117939    2576 policy_none.go:49] "None policy: Start"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.117952    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.117963    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 16:30:12.127171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.118886    2576 policy_none.go:47] "Start"
Jul 14 16:30:12.149361 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.149343    2576 manager.go:337] "Starting Device Plugin manager"
Jul 14 16:30:12.149496 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.149375    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 16:30:12.149496 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.149386    2576 server.go:87] "Starting device plugin registration server"
Jul 14 16:30:12.149656 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.149642    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 16:30:12.149722 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.149680    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 16:30:12.149792 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.149774    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 16:30:12.149903 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.149858    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 16:30:12.149903 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.149868    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 16:30:12.150456 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.150437    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 16:30:12.150551 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.150490    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.249838 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.249810    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:30:12.250940 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.250924    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:30:12.251030 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.250964    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:30:12.251030 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.250979    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:30:12.251030 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.251017    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.258576 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.258559    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.258633 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.258585    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-173.ec2.internal\": node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.271315 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.271288    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.298980 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.298948    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 16:30:12.300299 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.300279    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 16:30:12.300447 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.300327    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 16:30:12.300447 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.300364    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 16:30:12.300447 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.300407    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 16:30:12.305666 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.305648    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:30:12.371717 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.371673    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.401242 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.401178    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal"]
Jul 14 16:30:12.401339 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.401252    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:30:12.402286 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.402267    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:30:12.402383 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.402299    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:30:12.402383 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.402312    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:30:12.403664 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.403652    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:30:12.403848 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.403834    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.403937 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.403863    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:30:12.404419 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.404403    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:30:12.404490 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.404433    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:30:12.404490 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.404450    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:30:12.404490 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.404455    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:30:12.404490 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.404487    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:30:12.404623 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.404500    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:30:12.405670 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.405656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.405725 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.405681    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:30:12.406375 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.406350    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:30:12.406489 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.406382    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:30:12.406489 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.406396    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:30:12.429571 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.429547    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-173.ec2.internal\" not found" node="ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.434345 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.434329    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-173.ec2.internal\" not found" node="ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.472372 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.472345    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.490918 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.490890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6261ced1e7db1c9710339923c191579e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-173.ec2.internal\" (UID: \"6261ced1e7db1c9710339923c191579e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.491030 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.490922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7cac41afca72252d8040d069197d262-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal\" (UID: \"c7cac41afca72252d8040d069197d262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.491030 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.490940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7cac41afca72252d8040d069197d262-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal\" (UID: \"c7cac41afca72252d8040d069197d262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.572679 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.572638    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.591924 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.591894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6261ced1e7db1c9710339923c191579e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-173.ec2.internal\" (UID: \"6261ced1e7db1c9710339923c191579e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.592060 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.591932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7cac41afca72252d8040d069197d262-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal\" (UID: \"c7cac41afca72252d8040d069197d262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.592060 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.591968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7cac41afca72252d8040d069197d262-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal\" (UID: \"c7cac41afca72252d8040d069197d262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.592060 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.592017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7cac41afca72252d8040d069197d262-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal\" (UID: \"c7cac41afca72252d8040d069197d262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.592060 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.592021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6261ced1e7db1c9710339923c191579e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-173.ec2.internal\" (UID: \"6261ced1e7db1c9710339923c191579e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.592231 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.592118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7cac41afca72252d8040d069197d262-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal\" (UID: \"c7cac41afca72252d8040d069197d262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.675958 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.675881    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.733765 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.733736    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.738081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:12.737707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:12.776371 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.776341    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.883323 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.883284    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:12.987984 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:12.987894    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:13.013445 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.013418    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 16:30:13.013946 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.013577    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 16:30:13.088326 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:13.088293    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:13.098488 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.098459    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 16:25:12 +0000 UTC" deadline="2028-01-01 08:18:38.110447883 +0000 UTC"
Jul 14 16:30:13.098538 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.098496    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12855h48m25.011966909s"
Jul 14 16:30:13.190238 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:13.190192    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:13.291081 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:13.290989    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:13.347294 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.347263    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:30:13.392127 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:13.392096    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-173.ec2.internal\" not found"
Jul 14 16:30:13.445744 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.445716    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:30:13.489237 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.489204    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:13.500491 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.500467    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:30:13.504541 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.504522    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 16:30:13.505547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.505529    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal"
Jul 14 16:30:13.517283 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.517259    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 16:30:13.523877 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:13.523842    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6261ced1e7db1c9710339923c191579e.slice/crio-fa444bfa736cf03f444ed7e5b908ea7c5344bb58624b2bb6b14dfa6f5f268828 WatchSource:0}: Error finding container fa444bfa736cf03f444ed7e5b908ea7c5344bb58624b2bb6b14dfa6f5f268828: Status 404 returned error can't find the container with id fa444bfa736cf03f444ed7e5b908ea7c5344bb58624b2bb6b14dfa6f5f268828
Jul 14 16:30:13.524348 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:13.524329    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cac41afca72252d8040d069197d262.slice/crio-cf72b3eb3e17bb052633ccf6a195bff65d161da5980f96f9bb3953abe3e57304 WatchSource:0}: Error finding container cf72b3eb3e17bb052633ccf6a195bff65d161da5980f96f9bb3953abe3e57304: Status 404 returned error can't find the container with id cf72b3eb3e17bb052633ccf6a195bff65d161da5980f96f9bb3953abe3e57304
Jul 14 16:30:13.532079 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:13.532061    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:30:14.064981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.064937    2576 apiserver.go:52] "Watching apiserver"
Jul 14 16:30:14.076298 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.076268    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 16:30:14.076719 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.076692    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz","openshift-cluster-node-tuning-operator/tuned-7lrdq","openshift-dns/node-resolver-wsnfn","openshift-image-registry/node-ca-m6nbt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal","openshift-multus/multus-additional-cni-plugins-h5w9z","openshift-multus/multus-hh9bz","openshift-multus/network-metrics-daemon-vpvnl","openshift-network-diagnostics/network-check-target-gvx6q","openshift-network-operator/iptables-alerter-7mhxx","openshift-ovn-kubernetes/ovnkube-node-42hq5","kube-system/global-pull-secret-syncer-ngd5g","kube-system/konnectivity-agent-ngqzw"]
Jul 14 16:30:14.078316 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.078240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.080466 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.080311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.080466 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.080420    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:14.082161 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.082134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.083231 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.083175    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.084764 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.084742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.086159 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.085981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.087793 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.087700    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:14.087793 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.087765    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:14.088942 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.088922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.089777 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.089684    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 16:30:14.090409 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.090387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.091541 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.091519    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 16:30:14.091875 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.091854    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 16:30:14.092077 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.092058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:14.092184 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.092117    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:14.093922 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.093900    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6wgwn\""
Jul 14 16:30:14.094099 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.094077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.094176 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.094119    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 16:30:14.094338 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.094317    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.094993    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095047    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095197    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n45bd\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095280    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095398    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4lxww\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095610    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095623    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095891    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095919    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 16:30:14.095989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.095982    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 16:30:14.096591 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.096049    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 16:30:14.096591 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.096102    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rmmcc\""
Jul 14 16:30:14.096591 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.096132    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 16:30:14.096770 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.096648    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 16:30:14.096952 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.096934    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 16:30:14.097025 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.096954    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 16:30:14.097025 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.096985    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wcrnz\""
Jul 14 16:30:14.097132 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.097099    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tdmvv\""
Jul 14 16:30:14.097132 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.097119    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pp95f\""
Jul 14 16:30:14.097256 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.097126    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 16:30:14.099517 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-modprobe-d\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.099615 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-system-cni-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.099615 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-device-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.099615 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54a492db-3019-4748-89d1-0a4602b62505-host\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.099823 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14347276-abe7-4b13-bb5f-fc30155dde49-agent-certs\") pod \"konnectivity-agent-ngqzw\" (UID: \"14347276-abe7-4b13-bb5f-fc30155dde49\") " pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.099823 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14347276-abe7-4b13-bb5f-fc30155dde49-konnectivity-ca\") pod \"konnectivity-agent-ngqzw\" (UID: \"14347276-abe7-4b13-bb5f-fc30155dde49\") " pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.099823 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cnibin\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.099823 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-systemd\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.099823 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-cni-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysctl-d\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-kubernetes\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54a492db-3019-4748-89d1-0a4602b62505-serviceca\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.099988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-sys\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-os-release\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.100081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpsd\" (UniqueName: \"kubernetes.io/projected/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-kube-api-access-gwpsd\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-host\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100166    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-k8s-cni-cncf-io\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mcff\" (UniqueName: \"kubernetes.io/projected/54a492db-3019-4748-89d1-0a4602b62505-kube-api-access-2mcff\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-system-cni-dir\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc653759-c249-40da-8414-dfaf71580c27-tmp\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-netns\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100243    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-cni-multus\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww5nd\" (UniqueName: \"kubernetes.io/projected/51b86411-af56-443c-a087-bf1a66f67f51-kube-api-access-ww5nd\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-sys-fs\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rbf9\" (UniqueName: \"kubernetes.io/projected/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-kube-api-access-4rbf9\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysctl-conf\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.100508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-run\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7x8r\" (UniqueName: \"kubernetes.io/projected/cc653759-c249-40da-8414-dfaf71580c27-kube-api-access-j7x8r\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-cnibin\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-tmp-dir\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-os-release\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51b86411-af56-443c-a087-bf1a66f67f51-cni-binary-copy\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-cni-bin\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-dbus\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-kubelet\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-registration-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk6sw\" (UniqueName: \"kubernetes.io/projected/6f943647-1be4-438f-8064-b91942486841-kube-api-access-qk6sw\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100863    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rdcv\""
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysconfig\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-hostroot\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:14.101340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-conf-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100966    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-multus-certs\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.100998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-socket-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-var-lib-kubelet\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-socket-dir-parent\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-kubelet-config\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-hosts-file\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-lib-modules\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc653759-c249-40da-8414-dfaf71580c27-etc-tuned\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-etc-kubernetes\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51b86411-af56-443c-a087-bf1a66f67f51-multus-daemon-config\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.102221 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.101257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp7fb\" (UniqueName: \"kubernetes.io/projected/e9395a28-78ee-4802-81c5-838d64e1bc5a-kube-api-access-rp7fb\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.110004 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.109982    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 16:30:14.112637 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.111607    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 16:30:14.112637 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.111888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 16:30:14.112637 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.112179    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 16:30:14.115750 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.115351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l6hxc\""
Jul 14 16:30:14.115750 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.115572    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 16:30:14.115750 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.115621    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 16:30:14.118935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.118912    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 16:30:14.122971 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.122952    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:30:14.190588 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.190557    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 16:30:14.201906 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.201869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54a492db-3019-4748-89d1-0a4602b62505-host\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.202075 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.201918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14347276-abe7-4b13-bb5f-fc30155dde49-agent-certs\") pod \"konnectivity-agent-ngqzw\" (UID: \"14347276-abe7-4b13-bb5f-fc30155dde49\") " pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.202075 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.201947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14347276-abe7-4b13-bb5f-fc30155dde49-konnectivity-ca\") pod \"konnectivity-agent-ngqzw\" (UID: \"14347276-abe7-4b13-bb5f-fc30155dde49\") " pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.202075 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.201973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cnibin\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.202075 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.201999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-systemd\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.202075 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-cni-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.202075 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysctl-d\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-kubelet\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-cni-bin\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-kubernetes\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-env-overrides\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54a492db-3019-4748-89d1-0a4602b62505-serviceca\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-sys\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-os-release\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-node-log\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpsd\" (UniqueName: \"kubernetes.io/projected/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-kube-api-access-gwpsd\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-host\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cnibin\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-k8s-cni-cncf-io\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.202497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-k8s-cni-cncf-io\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysctl-d\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-ovn\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-cni-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mcff\" (UniqueName: \"kubernetes.io/projected/54a492db-3019-4748-89d1-0a4602b62505-kube-api-access-2mcff\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-system-cni-dir\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-sys\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc653759-c249-40da-8414-dfaf71580c27-tmp\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-kubernetes\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-netns\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-netns\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-cni-multus\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-slash\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4dt\" (UniqueName: \"kubernetes.io/projected/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-kube-api-access-fb4dt\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww5nd\" (UniqueName: \"kubernetes.io/projected/51b86411-af56-443c-a087-bf1a66f67f51-kube-api-access-ww5nd\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-sys-fs\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.203400 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.202947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-sys-fs\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203052    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203058    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54a492db-3019-4748-89d1-0a4602b62505-serviceca\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-os-release\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203377    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-system-cni-dir\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-host\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203420    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54a492db-3019-4748-89d1-0a4602b62505-host\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-cni-multus\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-systemd\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovn-node-metrics-cert\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14347276-abe7-4b13-bb5f-fc30155dde49-konnectivity-ca\") pod \"konnectivity-agent-ngqzw\" (UID: \"14347276-abe7-4b13-bb5f-fc30155dde49\") " pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tjqz\" (UniqueName: \"kubernetes.io/projected/917ac614-2e16-481b-a7a3-fdbb0171d5a0-kube-api-access-4tjqz\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203788    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-systemd\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.203854    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rbf9\" (UniqueName: \"kubernetes.io/projected/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-kube-api-access-4rbf9\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.204273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.203918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysctl-conf\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.203982    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret podName:aa5c33ea-b97d-43b0-b2c0-cb13816e0284 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:14.703940895 +0000 UTC m=+3.833925113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret") pod "global-pull-secret-syncer-ngd5g" (UID: "aa5c33ea-b97d-43b0-b2c0-cb13816e0284") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-run\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7x8r\" (UniqueName: \"kubernetes.io/projected/cc653759-c249-40da-8414-dfaf71580c27-kube-api-access-j7x8r\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-cnibin\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-run\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204296    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysctl-conf\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-systemd-units\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-log-socket\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-cnibin\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-run-ovn-kubernetes\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-tmp-dir\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-os-release\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-os-release\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-tmp-dir\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.205190 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.204797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51b86411-af56-443c-a087-bf1a66f67f51-cni-binary-copy\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205146    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-cni-bin\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-cni-bin\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51b86411-af56-443c-a087-bf1a66f67f51-cni-binary-copy\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-dbus\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-kubelet\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-registration-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-var-lib-kubelet\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-dbus\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-var-lib-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/917ac614-2e16-481b-a7a3-fdbb0171d5a0-iptables-alerter-script\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-registration-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk6sw\" (UniqueName: \"kubernetes.io/projected/6f943647-1be4-438f-8064-b91942486841-kube-api-access-qk6sw\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.206072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysconfig\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-hostroot\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-run-netns\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/917ac614-2e16-481b-a7a3-fdbb0171d5a0-host-slash\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-sysconfig\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-hostroot\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-conf-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-multus-certs\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-socket-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.205993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovnkube-script-lib\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-var-lib-kubelet\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-socket-dir-parent\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-etc-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-kubelet-config\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-hosts-file\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.206955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-lib-modules\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc653759-c249-40da-8414-dfaf71580c27-etc-tuned\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-etc-kubernetes\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51b86411-af56-443c-a087-bf1a66f67f51-multus-daemon-config\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp7fb\" (UniqueName: \"kubernetes.io/projected/e9395a28-78ee-4802-81c5-838d64e1bc5a-kube-api-access-rp7fb\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-modprobe-d\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-system-cni-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.206431    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-kubelet-config\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.206490    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs podName:6f943647-1be4-438f-8064-b91942486841 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:14.706469103 +0000 UTC m=+3.836453284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs") pod "network-metrics-daemon-vpvnl" (UID: "6f943647-1be4-438f-8064-b91942486841") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-hosts-file\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-device-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-system-cni-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-lib-modules\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-etc-modprobe-d\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-device-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.208095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc653759-c249-40da-8414-dfaf71580c27-var-lib-kubelet\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-socket-dir-parent\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-etc-kubernetes\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9395a28-78ee-4802-81c5-838d64e1bc5a-socket-dir\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.206980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-multus-conf-dir\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.207029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51b86411-af56-443c-a087-bf1a66f67f51-host-run-multus-certs\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.207073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-cni-netd\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.207107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovnkube-config\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.207683    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc653759-c249-40da-8414-dfaf71580c27-tmp\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.207865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51b86411-af56-443c-a087-bf1a66f67f51-multus-daemon-config\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.208981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.208270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14347276-abe7-4b13-bb5f-fc30155dde49-agent-certs\") pod \"konnectivity-agent-ngqzw\" (UID: \"14347276-abe7-4b13-bb5f-fc30155dde49\") " pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.209967 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.209922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc653759-c249-40da-8414-dfaf71580c27-etc-tuned\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.215904 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.215874    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8pnv"
Jul 14 16:30:14.222244 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.222164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp7fb\" (UniqueName: \"kubernetes.io/projected/e9395a28-78ee-4802-81c5-838d64e1bc5a-kube-api-access-rp7fb\") pod \"aws-ebs-csi-driver-node-79mmz\" (UID: \"e9395a28-78ee-4802-81c5-838d64e1bc5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.225167 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.225134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww5nd\" (UniqueName: \"kubernetes.io/projected/51b86411-af56-443c-a087-bf1a66f67f51-kube-api-access-ww5nd\") pod \"multus-hh9bz\" (UID: \"51b86411-af56-443c-a087-bf1a66f67f51\") " pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.227757 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.227678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk6sw\" (UniqueName: \"kubernetes.io/projected/6f943647-1be4-438f-8064-b91942486841-kube-api-access-qk6sw\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:14.228219 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.228097    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpsd\" (UniqueName: \"kubernetes.io/projected/f40e51cb-373d-4dbd-84e4-f5b7c7bd3131-kube-api-access-gwpsd\") pod \"node-resolver-wsnfn\" (UID: \"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131\") " pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.229412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.229388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mcff\" (UniqueName: \"kubernetes.io/projected/54a492db-3019-4748-89d1-0a4602b62505-kube-api-access-2mcff\") pod \"node-ca-m6nbt\" (UID: \"54a492db-3019-4748-89d1-0a4602b62505\") " pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.230851 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.230825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rbf9\" (UniqueName: \"kubernetes.io/projected/ec545905-2f5d-4ebf-8d42-2f19e4b13c13-kube-api-access-4rbf9\") pod \"multus-additional-cni-plugins-h5w9z\" (UID: \"ec545905-2f5d-4ebf-8d42-2f19e4b13c13\") " pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.234289 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.233840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7x8r\" (UniqueName: \"kubernetes.io/projected/cc653759-c249-40da-8414-dfaf71580c27-kube-api-access-j7x8r\") pod \"tuned-7lrdq\" (UID: \"cc653759-c249-40da-8414-dfaf71580c27\") " pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.241815 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.241458    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8pnv"
Jul 14 16:30:14.306921 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.306859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal" event={"ID":"c7cac41afca72252d8040d069197d262","Type":"ContainerStarted","Data":"cf72b3eb3e17bb052633ccf6a195bff65d161da5980f96f9bb3953abe3e57304"}
Jul 14 16:30:14.307566 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-systemd\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.307704 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovn-node-metrics-cert\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.307704 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjqz\" (UniqueName: \"kubernetes.io/projected/917ac614-2e16-481b-a7a3-fdbb0171d5a0-kube-api-access-4tjqz\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.307704 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-systemd-units\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.307704 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-systemd\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.307931 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-log-socket\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.307931 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-run-ovn-kubernetes\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.307931 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:14.307931 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-log-socket\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-var-lib-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-systemd-units\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/917ac614-2e16-481b-a7a3-fdbb0171d5a0-iptables-alerter-script\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.307989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-var-lib-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-run-ovn-kubernetes\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-run-netns\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/917ac614-2e16-481b-a7a3-fdbb0171d5a0-host-slash\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.308130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308094    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovnkube-script-lib\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/917ac614-2e16-481b-a7a3-fdbb0171d5a0-host-slash\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-etc-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-run-netns\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-cni-netd\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovnkube-config\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-kubelet\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-cni-bin\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-env-overrides\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-node-log\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-ovn\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-slash\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4dt\" (UniqueName: \"kubernetes.io/projected/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-kube-api-access-fb4dt\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-kubelet\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-cni-bin\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.308547 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/917ac614-2e16-481b-a7a3-fdbb0171d5a0-iptables-alerter-script\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-run-ovn\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-node-log\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-etc-openvswitch\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-cni-netd\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovnkube-script-lib\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-host-slash\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.308954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-env-overrides\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.309334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.309166    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovnkube-config\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.310007 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.309978    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal" event={"ID":"6261ced1e7db1c9710339923c191579e","Type":"ContainerStarted","Data":"fa444bfa736cf03f444ed7e5b908ea7c5344bb58624b2bb6b14dfa6f5f268828"}
Jul 14 16:30:14.311592 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.311526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-ovn-node-metrics-cert\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.317916 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.317860    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:30:14.317916 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.317889    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:30:14.317916 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.317902    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tnb9v for pod openshift-network-diagnostics/network-check-target-gvx6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:14.318126 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.317979    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v podName:cbebe223-6528-45a4-aa1f-6ca892d038b1 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:14.817959903 +0000 UTC m=+3.947944094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tnb9v" (UniqueName: "kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v") pod "network-check-target-gvx6q" (UID: "cbebe223-6528-45a4-aa1f-6ca892d038b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:14.320320 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.320288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tjqz\" (UniqueName: \"kubernetes.io/projected/917ac614-2e16-481b-a7a3-fdbb0171d5a0-kube-api-access-4tjqz\") pod \"iptables-alerter-7mhxx\" (UID: \"917ac614-2e16-481b-a7a3-fdbb0171d5a0\") " pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.327661 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.327637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4dt\" (UniqueName: \"kubernetes.io/projected/da4f98f2-3d8d-40cf-bc43-cfe9d8836881-kube-api-access-fb4dt\") pod \"ovnkube-node-42hq5\" (UID: \"da4f98f2-3d8d-40cf-bc43-cfe9d8836881\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.393518 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.393490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5w9z"
Jul 14 16:30:14.403021 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.402993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7lrdq"
Jul 14 16:30:14.404208 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.404183    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec545905_2f5d_4ebf_8d42_2f19e4b13c13.slice/crio-d4102f762d7e630b0c815c67f70f1c0445b22d93e81551fd8909d5753a3c3147 WatchSource:0}: Error finding container d4102f762d7e630b0c815c67f70f1c0445b22d93e81551fd8909d5753a3c3147: Status 404 returned error can't find the container with id d4102f762d7e630b0c815c67f70f1c0445b22d93e81551fd8909d5753a3c3147
Jul 14 16:30:14.411580 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.411553    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc653759_c249_40da_8414_dfaf71580c27.slice/crio-b64b57e5add53d4701c9ea01fa8ba88165e3375a5f3c0e29e1de2093ca3836ae WatchSource:0}: Error finding container b64b57e5add53d4701c9ea01fa8ba88165e3375a5f3c0e29e1de2093ca3836ae: Status 404 returned error can't find the container with id b64b57e5add53d4701c9ea01fa8ba88165e3375a5f3c0e29e1de2093ca3836ae
Jul 14 16:30:14.414021 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.413992    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7mhxx"
Jul 14 16:30:14.422611 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.422587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wsnfn"
Jul 14 16:30:14.431040 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.431017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6nbt"
Jul 14 16:30:14.437872 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.437850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:14.437992 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.437967    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917ac614_2e16_481b_a7a3_fdbb0171d5a0.slice/crio-91ce77c3c6d981c4adc02485846b7b78d188d6c22cbb59d67ee7df898dc751f6 WatchSource:0}: Error finding container 91ce77c3c6d981c4adc02485846b7b78d188d6c22cbb59d67ee7df898dc751f6: Status 404 returned error can't find the container with id 91ce77c3c6d981c4adc02485846b7b78d188d6c22cbb59d67ee7df898dc751f6
Jul 14 16:30:14.442834 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.442800    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40e51cb_373d_4dbd_84e4_f5b7c7bd3131.slice/crio-75a36541b667335e6ec2a02b370dddeb0bcc020823bfced205ffbc969941ae42 WatchSource:0}: Error finding container 75a36541b667335e6ec2a02b370dddeb0bcc020823bfced205ffbc969941ae42: Status 404 returned error can't find the container with id 75a36541b667335e6ec2a02b370dddeb0bcc020823bfced205ffbc969941ae42
Jul 14 16:30:14.445912 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.445888    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a492db_3019_4748_89d1_0a4602b62505.slice/crio-a56f9a783e040f9f59835fd0944d27f43b120f158fab7a90acc160e3516ac1cd WatchSource:0}: Error finding container a56f9a783e040f9f59835fd0944d27f43b120f158fab7a90acc160e3516ac1cd: Status 404 returned error can't find the container with id a56f9a783e040f9f59835fd0944d27f43b120f158fab7a90acc160e3516ac1cd
Jul 14 16:30:14.449159 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.449121    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14347276_abe7_4b13_bb5f_fc30155dde49.slice/crio-60201bafeff8bda7ef1b0381cbf4182cd696b8ae9f107a1f074952727ecdd762 WatchSource:0}: Error finding container 60201bafeff8bda7ef1b0381cbf4182cd696b8ae9f107a1f074952727ecdd762: Status 404 returned error can't find the container with id 60201bafeff8bda7ef1b0381cbf4182cd696b8ae9f107a1f074952727ecdd762
Jul 14 16:30:14.449886 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.449829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hh9bz"
Jul 14 16:30:14.458343 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.458321    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b86411_af56_443c_a087_bf1a66f67f51.slice/crio-2e5e29d5ab970deb7cea44fd28bd3fd38919a14ead64bf82c47d6838e362b18d WatchSource:0}: Error finding container 2e5e29d5ab970deb7cea44fd28bd3fd38919a14ead64bf82c47d6838e362b18d: Status 404 returned error can't find the container with id 2e5e29d5ab970deb7cea44fd28bd3fd38919a14ead64bf82c47d6838e362b18d
Jul 14 16:30:14.459476 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.459458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz"
Jul 14 16:30:14.465130 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.465109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:14.468293 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.468271    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9395a28_78ee_4802_81c5_838d64e1bc5a.slice/crio-c42e6312d9b7b64fa8ae2da424705db8979d3ebe40d2f6bc008905d590f728b2 WatchSource:0}: Error finding container c42e6312d9b7b64fa8ae2da424705db8979d3ebe40d2f6bc008905d590f728b2: Status 404 returned error can't find the container with id c42e6312d9b7b64fa8ae2da424705db8979d3ebe40d2f6bc008905d590f728b2
Jul 14 16:30:14.472436 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:14.472413    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4f98f2_3d8d_40cf_bc43_cfe9d8836881.slice/crio-442234fd37dced2a47ad633e94400a88ed9e4821f0a04d14a150a65df82604e1 WatchSource:0}: Error finding container 442234fd37dced2a47ad633e94400a88ed9e4821f0a04d14a150a65df82604e1: Status 404 returned error can't find the container with id 442234fd37dced2a47ad633e94400a88ed9e4821f0a04d14a150a65df82604e1
Jul 14 16:30:14.711010 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.710893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:14.711010 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.710967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:14.711247 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.711095    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:14.711247 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.711119    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:14.711247 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.711173    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs podName:6f943647-1be4-438f-8064-b91942486841 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:15.711157619 +0000 UTC m=+4.841141816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs") pod "network-metrics-daemon-vpvnl" (UID: "6f943647-1be4-438f-8064-b91942486841") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:14.711247 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.711191    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret podName:aa5c33ea-b97d-43b0-b2c0-cb13816e0284 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:15.711183984 +0000 UTC m=+4.841168164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret") pod "global-pull-secret-syncer-ngd5g" (UID: "aa5c33ea-b97d-43b0-b2c0-cb13816e0284") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:14.912710 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:14.912675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:14.912876 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.912823    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:30:14.912876 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.912842    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:30:14.912876 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.912851    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tnb9v for pod openshift-network-diagnostics/network-check-target-gvx6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:14.913051 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:14.912903    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v podName:cbebe223-6528-45a4-aa1f-6ca892d038b1 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:15.91288962 +0000 UTC m=+5.042873800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnb9v" (UniqueName: "kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v") pod "network-check-target-gvx6q" (UID: "cbebe223-6528-45a4-aa1f-6ca892d038b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:15.244585 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.244534    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:25:14 +0000 UTC" deadline="2028-02-16 09:34:39.430892361 +0000 UTC"
Jul 14 16:30:15.244585 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.244575    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13961h4m24.186322338s"
Jul 14 16:30:15.301061 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.301023    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:15.301223 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.301170    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:15.313160 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.313125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz" event={"ID":"e9395a28-78ee-4802-81c5-838d64e1bc5a","Type":"ContainerStarted","Data":"c42e6312d9b7b64fa8ae2da424705db8979d3ebe40d2f6bc008905d590f728b2"}
Jul 14 16:30:15.314433 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.314403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ngqzw" event={"ID":"14347276-abe7-4b13-bb5f-fc30155dde49","Type":"ContainerStarted","Data":"60201bafeff8bda7ef1b0381cbf4182cd696b8ae9f107a1f074952727ecdd762"}
Jul 14 16:30:15.315592 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.315566    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7mhxx" event={"ID":"917ac614-2e16-481b-a7a3-fdbb0171d5a0","Type":"ContainerStarted","Data":"91ce77c3c6d981c4adc02485846b7b78d188d6c22cbb59d67ee7df898dc751f6"}
Jul 14 16:30:15.316838 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.316810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerStarted","Data":"d4102f762d7e630b0c815c67f70f1c0445b22d93e81551fd8909d5753a3c3147"}
Jul 14 16:30:15.318248 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.318218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"442234fd37dced2a47ad633e94400a88ed9e4821f0a04d14a150a65df82604e1"}
Jul 14 16:30:15.319541 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.319511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hh9bz" event={"ID":"51b86411-af56-443c-a087-bf1a66f67f51","Type":"ContainerStarted","Data":"2e5e29d5ab970deb7cea44fd28bd3fd38919a14ead64bf82c47d6838e362b18d"}
Jul 14 16:30:15.320858 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.320834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6nbt" event={"ID":"54a492db-3019-4748-89d1-0a4602b62505","Type":"ContainerStarted","Data":"a56f9a783e040f9f59835fd0944d27f43b120f158fab7a90acc160e3516ac1cd"}
Jul 14 16:30:15.322177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.322156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wsnfn" event={"ID":"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131","Type":"ContainerStarted","Data":"75a36541b667335e6ec2a02b370dddeb0bcc020823bfced205ffbc969941ae42"}
Jul 14 16:30:15.323639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.323613    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7lrdq" event={"ID":"cc653759-c249-40da-8414-dfaf71580c27","Type":"ContainerStarted","Data":"b64b57e5add53d4701c9ea01fa8ba88165e3375a5f3c0e29e1de2093ca3836ae"}
Jul 14 16:30:15.719276 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.719122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:15.719276 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.719211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:15.719543 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.719416    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:15.719543 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.719499    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs podName:6f943647-1be4-438f-8064-b91942486841 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:17.719477045 +0000 UTC m=+6.849461250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs") pod "network-metrics-daemon-vpvnl" (UID: "6f943647-1be4-438f-8064-b91942486841") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:15.719955 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.719825    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:15.719955 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.719896    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret podName:aa5c33ea-b97d-43b0-b2c0-cb13816e0284 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:17.71987942 +0000 UTC m=+6.849863608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret") pod "global-pull-secret-syncer-ngd5g" (UID: "aa5c33ea-b97d-43b0-b2c0-cb13816e0284") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:15.921667 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:15.920951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:15.921667 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.921143    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:30:15.921667 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.921163    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:30:15.921667 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.921177    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tnb9v for pod openshift-network-diagnostics/network-check-target-gvx6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:15.921667 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:15.921239    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v podName:cbebe223-6528-45a4-aa1f-6ca892d038b1 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:17.921219202 +0000 UTC m=+7.051203387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnb9v" (UniqueName: "kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v") pod "network-check-target-gvx6q" (UID: "cbebe223-6528-45a4-aa1f-6ca892d038b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:16.245927 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:16.245623    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:25:14 +0000 UTC" deadline="2028-01-21 18:10:30.634708431 +0000 UTC"
Jul 14 16:30:16.245927 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:16.245927    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13345h40m14.388788604s"
Jul 14 16:30:16.301985 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:16.301932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:16.302177 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:16.302080    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:16.302780 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:16.302596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:16.302780 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:16.302734    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:16.338357 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:16.337827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal" event={"ID":"6261ced1e7db1c9710339923c191579e","Type":"ContainerStarted","Data":"dd0e806d5eca4838a311951124d043c3c7e57e9147e0e672ece1070d3f4651f9"}
Jul 14 16:30:16.358226 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:16.357828    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-173.ec2.internal" podStartSLOduration=3.357804394 podStartE2EDuration="3.357804394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:16.357528045 +0000 UTC m=+5.487512250" watchObservedRunningTime="2026-07-14 16:30:16.357804394 +0000 UTC m=+5.487788597"
Jul 14 16:30:17.301217 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:17.301184    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:17.301742 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.301321    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:17.345546 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:17.345508    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal" event={"ID":"c7cac41afca72252d8040d069197d262","Type":"ContainerStarted","Data":"ecb74c9573f8be0257ab62b27ca4f197009d3eb11d5f9bd38a476b8f302c6061"}
Jul 14 16:30:17.737579 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:17.737534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:17.737768 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:17.737628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:17.737823 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.737798    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:17.737886 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.737866    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret podName:aa5c33ea-b97d-43b0-b2c0-cb13816e0284 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:21.737844485 +0000 UTC m=+10.867828671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret") pod "global-pull-secret-syncer-ngd5g" (UID: "aa5c33ea-b97d-43b0-b2c0-cb13816e0284") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:17.738308 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.738286    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:17.738386 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.738355    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs podName:6f943647-1be4-438f-8064-b91942486841 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:21.73833649 +0000 UTC m=+10.868320669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs") pod "network-metrics-daemon-vpvnl" (UID: "6f943647-1be4-438f-8064-b91942486841") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:17.939229 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:17.939195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:17.939414 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.939372    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:30:17.939414 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.939390    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:30:17.939414 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.939400    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tnb9v for pod openshift-network-diagnostics/network-check-target-gvx6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:17.939583 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:17.939458    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v podName:cbebe223-6528-45a4-aa1f-6ca892d038b1 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:21.939440475 +0000 UTC m=+11.069424676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnb9v" (UniqueName: "kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v") pod "network-check-target-gvx6q" (UID: "cbebe223-6528-45a4-aa1f-6ca892d038b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:18.301660 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:18.301610    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:18.302160 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:18.301770    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:18.302160 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:18.301850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:18.302160 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:18.301938    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:19.300713 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:19.300675    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:19.300887 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:19.300814    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:19.351022 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:19.350936    2576 generic.go:356] "Generic (PLEG): container finished" podID="c7cac41afca72252d8040d069197d262" containerID="ecb74c9573f8be0257ab62b27ca4f197009d3eb11d5f9bd38a476b8f302c6061" exitCode=0
Jul 14 16:30:19.351022 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:19.350994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal" event={"ID":"c7cac41afca72252d8040d069197d262","Type":"ContainerDied","Data":"ecb74c9573f8be0257ab62b27ca4f197009d3eb11d5f9bd38a476b8f302c6061"}
Jul 14 16:30:20.303368 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:20.302739    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:20.303368 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:20.302883    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:20.303368 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:20.302742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:20.303368 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:20.303313    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:21.300746 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:21.300702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:21.301213 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.300840    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:21.776985 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:21.776945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:21.777241 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:21.777223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:21.779154 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.779124    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:21.779262 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.779223    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs podName:6f943647-1be4-438f-8064-b91942486841 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:29.779199626 +0000 UTC m=+18.909183812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs") pod "network-metrics-daemon-vpvnl" (UID: "6f943647-1be4-438f-8064-b91942486841") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:21.782013 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.779768    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:21.782013 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.779842    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret podName:aa5c33ea-b97d-43b0-b2c0-cb13816e0284 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:29.779819589 +0000 UTC m=+18.909803783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret") pod "global-pull-secret-syncer-ngd5g" (UID: "aa5c33ea-b97d-43b0-b2c0-cb13816e0284") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:21.978996 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:21.978807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:21.978996 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.978955    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:30:21.978996 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.978976    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:30:21.978996 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.978989    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tnb9v for pod openshift-network-diagnostics/network-check-target-gvx6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:21.979227 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:21.979044    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v podName:cbebe223-6528-45a4-aa1f-6ca892d038b1 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:29.979032033 +0000 UTC m=+19.109016212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnb9v" (UniqueName: "kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v") pod "network-check-target-gvx6q" (UID: "cbebe223-6528-45a4-aa1f-6ca892d038b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:22.301757 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:22.301673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:22.302279 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:22.301779    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:22.302279 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:22.301815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:22.302279 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:22.301909    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:23.300899 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:23.300866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:23.301064 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:23.300987    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:24.301213 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:24.301178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:24.301213 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:24.301216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:24.301763 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:24.301309    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:24.301763 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:24.301414    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:25.300884 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:25.300842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:25.301070 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:25.300986    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:26.300946 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:26.300910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:26.301460 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:26.300910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:26.301460 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:26.301035    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:26.301460 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:26.301116    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:27.300722 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:27.300690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:27.300890 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:27.300796    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:28.300794 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:28.300764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:28.300794 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:28.300778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:28.301261 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:28.300899    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:28.301261 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:28.301002    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:29.300715 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:29.300678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:29.300911 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:29.300791    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:29.840462 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:29.840425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:29.840770 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:29.840492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:29.840770 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:29.840604    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:29.840770 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:29.840615    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:29.840770 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:29.840669    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs podName:6f943647-1be4-438f-8064-b91942486841 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.840653419 +0000 UTC m=+34.970637597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs") pod "network-metrics-daemon-vpvnl" (UID: "6f943647-1be4-438f-8064-b91942486841") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:29.840770 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:29.840695    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret podName:aa5c33ea-b97d-43b0-b2c0-cb13816e0284 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.840677651 +0000 UTC m=+34.970661844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret") pod "global-pull-secret-syncer-ngd5g" (UID: "aa5c33ea-b97d-43b0-b2c0-cb13816e0284") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:30.041941 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:30.041905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:30.042110 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:30.042062    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:30:30.042110 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:30.042084    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:30:30.042110 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:30.042097    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tnb9v for pod openshift-network-diagnostics/network-check-target-gvx6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:30.042265 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:30.042157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v podName:cbebe223-6528-45a4-aa1f-6ca892d038b1 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:46.042138213 +0000 UTC m=+35.172122411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnb9v" (UniqueName: "kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v") pod "network-check-target-gvx6q" (UID: "cbebe223-6528-45a4-aa1f-6ca892d038b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:30.301253 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:30.301193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:30.301691 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:30.301327    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:30.301691 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:30.301434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:30.301691 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:30.301543    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:31.301309 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:31.301274    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:31.301797 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:31.301389    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:32.301910 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:32.301873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:32.302348 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:32.301993    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:32.302348 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:32.302052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:32.302348 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:32.302180    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:33.300986 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:33.300953    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:33.301172 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:33.301048    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:34.301937 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.301619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:34.302529 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.301698    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:34.302529 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:34.302018    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:34.302529 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:34.302105    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:34.380299 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.380268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz" event={"ID":"e9395a28-78ee-4802-81c5-838d64e1bc5a","Type":"ContainerStarted","Data":"53aa656504671fe0af5a07e177c5885e954f0892fc537cebd51a41642ffc7af9"}
Jul 14 16:30:34.382268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.382235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ngqzw" event={"ID":"14347276-abe7-4b13-bb5f-fc30155dde49","Type":"ContainerStarted","Data":"89767d7e8cf426db052c367af1e059e78c9e1a2985a9eb1e1c0348218f9e73ee"}
Jul 14 16:30:34.383948 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.383923    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec545905-2f5d-4ebf-8d42-2f19e4b13c13" containerID="2df856e349e429b01feb54547d4f9079971895885265ee34136f0bcd5f94c3d7" exitCode=0
Jul 14 16:30:34.384016 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.384000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerDied","Data":"2df856e349e429b01feb54547d4f9079971895885265ee34136f0bcd5f94c3d7"}
Jul 14 16:30:34.389757 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.389562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"7df8e4390bbba405bbf9a060f1d94556f3c6a2fa6d55f073519d0acc327eb05c"}
Jul 14 16:30:34.389757 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.389669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"750c358c46cc54d27dba8abfcf27138a2ddc4808f83c5e773e92276bf3634a65"}
Jul 14 16:30:34.389757 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.389723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"441d7767da98f5126aea03145fff10f1978d6676819ec551b7a6a77a215e5824"}
Jul 14 16:30:34.389932 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.389772    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"bc01e728293a6b869ca445abbc0b0930a50f38ff3205bbe933e6327f3331aa64"}
Jul 14 16:30:34.391589 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.391522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hh9bz" event={"ID":"51b86411-af56-443c-a087-bf1a66f67f51","Type":"ContainerStarted","Data":"ca5b9aa1b8433868243474ec6e2585c27e6a7d59e988d3801161483621dfdb17"}
Jul 14 16:30:34.393094 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.393050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6nbt" event={"ID":"54a492db-3019-4748-89d1-0a4602b62505","Type":"ContainerStarted","Data":"a9be14a0a169c5f65152cc2ad7d10aae9d1b7c78e16b09a8cd779a6b333b8b54"}
Jul 14 16:30:34.395196 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.395171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wsnfn" event={"ID":"f40e51cb-373d-4dbd-84e4-f5b7c7bd3131","Type":"ContainerStarted","Data":"6126e910f12f85dab1e7314d31d63e3546bd2a5c61dc849873b263d6d9d53568"}
Jul 14 16:30:34.397227 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.397204    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7lrdq" event={"ID":"cc653759-c249-40da-8414-dfaf71580c27","Type":"ContainerStarted","Data":"358960de13522ee198f7415d049ce7a48396a624dd25757a00abbd6a1826db97"}
Jul 14 16:30:34.399884 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.399862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal" event={"ID":"c7cac41afca72252d8040d069197d262","Type":"ContainerStarted","Data":"ca606fa0a8bdb57b533a988015310bd1761f2ead54e0d3a536fd6b2fcb9f16b4"}
Jul 14 16:30:34.400539 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.400489    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ngqzw" podStartSLOduration=3.104213277 podStartE2EDuration="22.400470698s" totalImagesPullingTime="19.296257421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:34.399613448 +0000 UTC m=+23.529597660" watchObservedRunningTime="2026-07-14 16:30:34.400470698 +0000 UTC m=+23.530454898"
Jul 14 16:30:34.418351 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.418304    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wsnfn" podStartSLOduration=3.084984314 podStartE2EDuration="22.418287372s" totalImagesPullingTime="19.333303058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:34.418077872 +0000 UTC m=+23.548062073" watchObservedRunningTime="2026-07-14 16:30:34.418287372 +0000 UTC m=+23.548271577"
Jul 14 16:30:34.456526 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.455022    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m6nbt" podStartSLOduration=3.09380798 podStartE2EDuration="22.455002281s" totalImagesPullingTime="19.361194301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:34.43410415 +0000 UTC m=+23.564088351" watchObservedRunningTime="2026-07-14 16:30:34.455002281 +0000 UTC m=+23.584986482"
Jul 14 16:30:34.478578 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.478526    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7lrdq" podStartSLOduration=3.082531205 podStartE2EDuration="22.478507156s" totalImagesPullingTime="19.395975951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:34.478120675 +0000 UTC m=+23.608104876" watchObservedRunningTime="2026-07-14 16:30:34.478507156 +0000 UTC m=+23.608491359"
Jul 14 16:30:34.478981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.478939    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hh9bz" podStartSLOduration=2.823191972 podStartE2EDuration="22.478924038s" totalImagesPullingTime="19.655732066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:34.457348577 +0000 UTC m=+23.587332774" watchObservedRunningTime="2026-07-14 16:30:34.478924038 +0000 UTC m=+23.608908249"
Jul 14 16:30:34.524443 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:34.524386    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-173.ec2.internal" podStartSLOduration=21.524370119 podStartE2EDuration="21.524370119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:34.523681524 +0000 UTC m=+23.653665727" watchObservedRunningTime="2026-07-14 16:30:34.524370119 +0000 UTC m=+23.654354319"
Jul 14 16:30:35.301606 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.301579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:35.301743 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:35.301699    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:35.371224 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.371118    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 16:30:35.403943 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.403878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz" event={"ID":"e9395a28-78ee-4802-81c5-838d64e1bc5a","Type":"ContainerStarted","Data":"e5f942bb1958f852e98f321489cb395bcef79f23234405cc3b2b7289405a7c66"}
Jul 14 16:30:35.405391 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.405369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7mhxx" event={"ID":"917ac614-2e16-481b-a7a3-fdbb0171d5a0","Type":"ContainerStarted","Data":"c353d0654fade775453dd93949e1f329c8983a8bdf42b14dae3dfc752e65a565"}
Jul 14 16:30:35.409468 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.409445    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"72255c1f6d83311f18b1c57c38eefb6bf575c4ebdf4bc94ef11caf14f529da17"}
Jul 14 16:30:35.409574 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.409516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"860c6af1f2b3c07943f8272f9b49a8dc251a0259fddc9a2e68587166c811b654"}
Jul 14 16:30:35.430127 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.430077    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7mhxx" podStartSLOduration=8.781394402 podStartE2EDuration="23.430062458s" totalImagesPullingTime="14.648668056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:35.429847301 +0000 UTC m=+24.559831493" watchObservedRunningTime="2026-07-14 16:30:35.430062458 +0000 UTC m=+24.560046658"
Jul 14 16:30:35.995365 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.995324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:35.995955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:35.995931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:36.162111 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.162006    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T16:30:35.371140615Z","UUID":"cc58949e-9c50-4050-a5b1-9d08e3887b1f","Handler":null,"Name":"","Endpoint":""}
Jul 14 16:30:36.163689 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.163662    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 16:30:36.163833 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.163711    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 16:30:36.301211 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.300962    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:36.301211 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.301007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:36.301211 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:36.301104    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:36.301404 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:36.301313    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:36.414714 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.414171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz" event={"ID":"e9395a28-78ee-4802-81c5-838d64e1bc5a","Type":"ContainerStarted","Data":"de630e345e210359809388107ed3f9ac88df8b0359a9c9935818fced180c8008"}
Jul 14 16:30:36.414714 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.414566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:36.415308 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.415173    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ngqzw"
Jul 14 16:30:36.451494 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:36.451435    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mmz" podStartSLOduration=7.71456038 podStartE2EDuration="24.451415607s" totalImagesPullingTime="16.736855227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:36.450210235 +0000 UTC m=+25.580194438" watchObservedRunningTime="2026-07-14 16:30:36.451415607 +0000 UTC m=+25.581399807"
Jul 14 16:30:37.301337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:37.301294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:37.301512 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:37.301407    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:37.421063 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:37.420851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"f4c4905df7e15850e271afc9823bc49bbe927babecfc1442f50e576874fd898a"}
Jul 14 16:30:38.301124 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:38.301082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:38.301345 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:38.301087    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:38.301345 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:38.301220    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:38.301345 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:38.301284    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:39.300944 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.300774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:39.301652 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:39.301021    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:39.427658 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.427609    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec545905-2f5d-4ebf-8d42-2f19e4b13c13" containerID="fce6c08a4c9e251a996772a990a0927b2090f70fffea18755ec0051e222c07a6" exitCode=0
Jul 14 16:30:39.427658 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.427655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerDied","Data":"fce6c08a4c9e251a996772a990a0927b2090f70fffea18755ec0051e222c07a6"}
Jul 14 16:30:39.433472 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.433433    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" event={"ID":"da4f98f2-3d8d-40cf-bc43-cfe9d8836881","Type":"ContainerStarted","Data":"483db8684bb03617647f0fa94b712028a726a20860e575b25964a76ab63155fa"}
Jul 14 16:30:39.433746 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.433723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:39.433894 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.433825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:39.449081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.449059    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:39.485640 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:39.485559    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5" podStartSLOduration=8.093779149 podStartE2EDuration="27.485545196s" totalImagesPullingTime="19.391766047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:39.483954417 +0000 UTC m=+28.613938617" watchObservedRunningTime="2026-07-14 16:30:39.485545196 +0000 UTC m=+28.615529396"
Jul 14 16:30:40.304020 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:40.303995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:40.304411 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:40.304101    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:40.304411 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:40.304152    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:40.304411 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:40.304268    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:40.437521 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:40.437488    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec545905-2f5d-4ebf-8d42-2f19e4b13c13" containerID="4bd4ae8d042ea725ad00cccf5e5193ec3345116e38d6980920909274aaa01362" exitCode=0
Jul 14 16:30:40.437688 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:40.437570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerDied","Data":"4bd4ae8d042ea725ad00cccf5e5193ec3345116e38d6980920909274aaa01362"}
Jul 14 16:30:40.438020 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:40.437998    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:40.453125 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:40.453106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:30:41.146548 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.146314    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ngd5g"]
Jul 14 16:30:41.146732 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.146714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:41.146846 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:41.146823    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:41.147090 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.147072    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvx6q"]
Jul 14 16:30:41.147213 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.147196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:41.147336 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:41.147276    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:41.148226 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.148199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vpvnl"]
Jul 14 16:30:41.148323 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.148313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:41.148434 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:41.148412    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:41.442285 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.442254    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec545905-2f5d-4ebf-8d42-2f19e4b13c13" containerID="c037c0ccfbf33266d5382af429d739462fae6fcff1a29db1eb9443bee8d235e2" exitCode=0
Jul 14 16:30:41.442723 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:41.442336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerDied","Data":"c037c0ccfbf33266d5382af429d739462fae6fcff1a29db1eb9443bee8d235e2"}
Jul 14 16:30:42.304107 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:42.304072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:42.304299 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:42.304072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:42.304299 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:42.304189    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:42.304299 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:42.304270    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:43.301551 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:43.301504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:43.302005 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:43.301614    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:44.304891 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:44.304864    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:44.305352 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:44.305054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:44.305352 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:44.305146    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:44.305352 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:44.305279    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:45.301393 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:45.301357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:45.301587 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:45.301488    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ngd5g" podUID="aa5c33ea-b97d-43b0-b2c0-cb13816e0284"
Jul 14 16:30:45.854660 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:45.854608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:45.855206 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:45.854696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:45.855206 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:45.854772    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:45.855206 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:45.854808    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:45.855206 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:45.854852    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs podName:6f943647-1be4-438f-8064-b91942486841 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:17.854831132 +0000 UTC m=+66.984815315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs") pod "network-metrics-daemon-vpvnl" (UID: "6f943647-1be4-438f-8064-b91942486841") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:30:45.855206 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:45.854875    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret podName:aa5c33ea-b97d-43b0-b2c0-cb13816e0284 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:17.854861984 +0000 UTC m=+66.984846165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret") pod "global-pull-secret-syncer-ngd5g" (UID: "aa5c33ea-b97d-43b0-b2c0-cb13816e0284") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:30:45.937007 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:45.936979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wsnfn_f40e51cb-373d-4dbd-84e4-f5b7c7bd3131/dns-node-resolver/0.log"
Jul 14 16:30:46.056942 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:46.056907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:46.057185 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:46.057107    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:30:46.057185 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:46.057134    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:30:46.057185 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:46.057148    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tnb9v for pod openshift-network-diagnostics/network-check-target-gvx6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:46.057312 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:46.057213    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v podName:cbebe223-6528-45a4-aa1f-6ca892d038b1 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:18.057193296 +0000 UTC m=+67.187177477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnb9v" (UniqueName: "kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v") pod "network-check-target-gvx6q" (UID: "cbebe223-6528-45a4-aa1f-6ca892d038b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:30:46.300619 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:46.300576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:46.300898 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:46.300589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:46.300898 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:46.300715    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvx6q" podUID="cbebe223-6528-45a4-aa1f-6ca892d038b1"
Jul 14 16:30:46.300898 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:46.300783    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpvnl" podUID="6f943647-1be4-438f-8064-b91942486841"
Jul 14 16:30:46.704450 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:46.704424    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6nbt_54a492db-3019-4748-89d1-0a4602b62505/node-ca/0.log"
Jul 14 16:30:47.195824 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.195789    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-173.ec2.internal" event="NodeReady"
Jul 14 16:30:47.196241 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.195938    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 16:30:47.282533 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.282505    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5cmwb"]
Jul 14 16:30:47.299123 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.299100    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gslgw"]
Jul 14 16:30:47.299123 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.299111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.304905 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.304880    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tkzdw\""
Jul 14 16:30:47.305035 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.304954    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 16:30:47.306006 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.305989    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 16:30:47.306119 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.306037    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 16:30:47.317526 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.317507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5cmwb"]
Jul 14 16:30:47.317652 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.317591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:30:47.317652 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.317610    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.329320 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.329301    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 16:30:47.329943 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.329921    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 16:30:47.330050 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.329990    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 16:30:47.330050 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.330038    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 16:30:47.330369 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.330353    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbmcg\""
Jul 14 16:30:47.330580 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.330565    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 16:30:47.330682 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.330583    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gslgw"]
Jul 14 16:30:47.347101 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.347081    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wj6gc"]
Jul 14 16:30:47.361981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.361964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.368824 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.368806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wj6gc"]
Jul 14 16:30:47.370200 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.370184    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 16:30:47.370397 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.370384    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 16:30:47.370473 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.370400    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jq9rg\""
Jul 14 16:30:47.465562 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b132d8c8-2160-4dd4-ae8a-8bf037850031-config-volume\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.465562 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn5rw\" (UniqueName: \"kubernetes.io/projected/26f11cc4-07c7-4405-8f94-c491b5cd499a-kube-api-access-rn5rw\") pod \"ingress-canary-5cmwb\" (UID: \"26f11cc4-07c7-4405-8f94-c491b5cd499a\") " pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.465562 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bzz6\" (UniqueName: \"kubernetes.io/projected/b132d8c8-2160-4dd4-ae8a-8bf037850031-kube-api-access-7bzz6\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26f11cc4-07c7-4405-8f94-c491b5cd499a-cert\") pod \"ingress-canary-5cmwb\" (UID: \"26f11cc4-07c7-4405-8f94-c491b5cd499a\") " pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-crio-socket\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-data-volume\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j89xd\" (UniqueName: \"kubernetes.io/projected/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-api-access-j89xd\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.465854 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.465834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b132d8c8-2160-4dd4-ae8a-8bf037850031-tmp-dir\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.567120 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.567120 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26f11cc4-07c7-4405-8f94-c491b5cd499a-cert\") pod \"ingress-canary-5cmwb\" (UID: \"26f11cc4-07c7-4405-8f94-c491b5cd499a\") " pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.567328 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-crio-socket\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.567328 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:47.567207    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:30:47.567328 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-data-volume\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.567328 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.567328 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j89xd\" (UniqueName: \"kubernetes.io/projected/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-api-access-j89xd\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.567328 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:47.567290    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.067267056 +0000 UTC m=+37.197251257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : configmap "kube-rbac-proxy" not found
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b132d8c8-2160-4dd4-ae8a-8bf037850031-tmp-dir\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:47.567347    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b132d8c8-2160-4dd4-ae8a-8bf037850031-config-volume\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:47.567398    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls podName:b132d8c8-2160-4dd4-ae8a-8bf037850031 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.067383389 +0000 UTC m=+37.197367581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls") pod "dns-default-wj6gc" (UID: "b132d8c8-2160-4dd4-ae8a-8bf037850031") : secret "dns-default-metrics-tls" not found
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-crio-socket\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn5rw\" (UniqueName: \"kubernetes.io/projected/26f11cc4-07c7-4405-8f94-c491b5cd499a-kube-api-access-rn5rw\") pod \"ingress-canary-5cmwb\" (UID: \"26f11cc4-07c7-4405-8f94-c491b5cd499a\") " pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567544    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-data-volume\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.567620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bzz6\" (UniqueName: \"kubernetes.io/projected/b132d8c8-2160-4dd4-ae8a-8bf037850031-kube-api-access-7bzz6\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.567954 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:47.567651    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:47.567954 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:47.567695    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.067681418 +0000 UTC m=+37.197665596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:47.567954 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b132d8c8-2160-4dd4-ae8a-8bf037850031-tmp-dir\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.567954 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.567894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b132d8c8-2160-4dd4-ae8a-8bf037850031-config-volume\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.571241 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.571219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26f11cc4-07c7-4405-8f94-c491b5cd499a-cert\") pod \"ingress-canary-5cmwb\" (UID: \"26f11cc4-07c7-4405-8f94-c491b5cd499a\") " pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.580029 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.580006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j89xd\" (UniqueName: \"kubernetes.io/projected/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-api-access-j89xd\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:47.581202 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.581182    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bzz6\" (UniqueName: \"kubernetes.io/projected/b132d8c8-2160-4dd4-ae8a-8bf037850031-kube-api-access-7bzz6\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:47.581906 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.581889    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn5rw\" (UniqueName: \"kubernetes.io/projected/26f11cc4-07c7-4405-8f94-c491b5cd499a-kube-api-access-rn5rw\") pod \"ingress-canary-5cmwb\" (UID: \"26f11cc4-07c7-4405-8f94-c491b5cd499a\") " pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.608434 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.608410    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5cmwb"
Jul 14 16:30:47.849531 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:47.849289    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5cmwb"]
Jul 14 16:30:47.851700 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:47.851672    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f11cc4_07c7_4405_8f94_c491b5cd499a.slice/crio-49ec75567d082f624bab80acb6c62153b1fc72b306c23b46eea65b7bf75b5cc4 WatchSource:0}: Error finding container 49ec75567d082f624bab80acb6c62153b1fc72b306c23b46eea65b7bf75b5cc4: Status 404 returned error can't find the container with id 49ec75567d082f624bab80acb6c62153b1fc72b306c23b46eea65b7bf75b5cc4
Jul 14 16:30:48.071949 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.071915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:48.072134 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.071963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:48.072134 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.071986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:48.072134 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:48.072064    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:30:48.072134 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:48.072076    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:30:48.072134 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:48.072089    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:48.072134 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:48.072136    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls podName:b132d8c8-2160-4dd4-ae8a-8bf037850031 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:49.072122778 +0000 UTC m=+38.202106956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls") pod "dns-default-wj6gc" (UID: "b132d8c8-2160-4dd4-ae8a-8bf037850031") : secret "dns-default-metrics-tls" not found
Jul 14 16:30:48.072361 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:48.072148    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:49.072142034 +0000 UTC m=+38.202126213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:48.072361 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:48.072160    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:49.072155333 +0000 UTC m=+38.202139510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : configmap "kube-rbac-proxy" not found
Jul 14 16:30:48.309337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.309311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:30:48.310098 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.309499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:30:48.313734 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.313692    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 16:30:48.313734 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.313696    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 16:30:48.313920 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.313747    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cr5gm\""
Jul 14 16:30:48.313920 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.313768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2hfc\""
Jul 14 16:30:48.313920 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.313714    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 16:30:48.460845 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.460807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5cmwb" event={"ID":"26f11cc4-07c7-4405-8f94-c491b5cd499a","Type":"ContainerStarted","Data":"49ec75567d082f624bab80acb6c62153b1fc72b306c23b46eea65b7bf75b5cc4"}
Jul 14 16:30:48.463924 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.463896    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec545905-2f5d-4ebf-8d42-2f19e4b13c13" containerID="4f3124e649736fcb802ba6cdf24a233aa62a5463844b38b20b65f7dcf0ebc7cb" exitCode=0
Jul 14 16:30:48.464058 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:48.463950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerDied","Data":"4f3124e649736fcb802ba6cdf24a233aa62a5463844b38b20b65f7dcf0ebc7cb"}
Jul 14 16:30:49.080817 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:49.080760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:49.081014 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:49.080835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:49.081014 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:49.080870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:49.081014 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:49.080924    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:49.081014 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:49.080954    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:30:49.081014 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:49.080996    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:51.080979235 +0000 UTC m=+40.210963433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:49.081014 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:49.080999    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:30:49.081014 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:49.081011    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:51.081005529 +0000 UTC m=+40.210989706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : configmap "kube-rbac-proxy" not found
Jul 14 16:30:49.081544 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:49.081042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls podName:b132d8c8-2160-4dd4-ae8a-8bf037850031 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:51.081027806 +0000 UTC m=+40.211011996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls") pod "dns-default-wj6gc" (UID: "b132d8c8-2160-4dd4-ae8a-8bf037850031") : secret "dns-default-metrics-tls" not found
Jul 14 16:30:49.470878 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:49.470793    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec545905-2f5d-4ebf-8d42-2f19e4b13c13" containerID="8c07befbfd1d665157dc9512eab62e2febe164a72a15383c8f817799ba2bb328" exitCode=0
Jul 14 16:30:49.470878 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:49.470851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerDied","Data":"8c07befbfd1d665157dc9512eab62e2febe164a72a15383c8f817799ba2bb328"}
Jul 14 16:30:50.475074 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:50.474792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5cmwb" event={"ID":"26f11cc4-07c7-4405-8f94-c491b5cd499a","Type":"ContainerStarted","Data":"7be394a078ff8cd1c0105d4585d7027e78543c87e37102ea794e37222b0384ca"}
Jul 14 16:30:50.477939 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:50.477917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" event={"ID":"ec545905-2f5d-4ebf-8d42-2f19e4b13c13","Type":"ContainerStarted","Data":"b369ef8b7d1f4d9675674375b91552e757ec49a49d651ebacbc40993d1269acf"}
Jul 14 16:30:50.509376 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:50.509332    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5cmwb" podStartSLOduration=1.243651602 podStartE2EDuration="3.509316764s" totalImagesPullingTime="2.265665162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:50.50919383 +0000 UTC m=+39.639178041" watchObservedRunningTime="2026-07-14 16:30:50.509316764 +0000 UTC m=+39.639300964"
Jul 14 16:30:51.096691 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:51.096649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:51.096848 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:51.096714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:51.096848 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:51.096749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:51.096848 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:51.096807    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:51.096948 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:51.096859    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 16:30:51.096948 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:51.096872    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:55.096852705 +0000 UTC m=+44.226836912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:51.096948 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:51.096891    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls podName:b132d8c8-2160-4dd4-ae8a-8bf037850031 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:55.096881071 +0000 UTC m=+44.226865248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls") pod "dns-default-wj6gc" (UID: "b132d8c8-2160-4dd4-ae8a-8bf037850031") : secret "dns-default-metrics-tls" not found
Jul 14 16:30:51.096948 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:51.096896    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:30:51.097074 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:51.096962    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:30:55.096947765 +0000 UTC m=+44.226931966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : configmap "kube-rbac-proxy" not found
Jul 14 16:30:55.127901 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.127859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:55.128443 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.127915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:30:55.128443 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.127938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:55.128443 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:55.128001    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 16:30:55.128443 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:55.128016    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:55.128443 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:55.128070    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:31:03.128055399 +0000 UTC m=+52.258039580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : secret "insights-runtime-extractor-tls" not found
Jul 14 16:30:55.128443 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:30:55.128092    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm podName:7af01769-5d4f-4abf-9c9f-8123d4f5b03e nodeName:}" failed. No retries permitted until 2026-07-14 16:31:03.128077021 +0000 UTC m=+52.258061198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gslgw" (UID: "7af01769-5d4f-4abf-9c9f-8123d4f5b03e") : configmap "kube-rbac-proxy" not found
Jul 14 16:30:55.131933 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.131911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b132d8c8-2160-4dd4-ae8a-8bf037850031-metrics-tls\") pod \"dns-default-wj6gc\" (UID: \"b132d8c8-2160-4dd4-ae8a-8bf037850031\") " pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:55.170671 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.170639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:30:55.326822 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.326767    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h5w9z" podStartSLOduration=11.667223565 podStartE2EDuration="43.326747787s" totalImagesPullingTime="31.659524222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:50.576612171 +0000 UTC m=+39.706596373" watchObservedRunningTime="2026-07-14 16:30:55.326747787 +0000 UTC m=+44.456731992"
Jul 14 16:30:55.327023 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.326944    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wj6gc"]
Jul 14 16:30:55.330177 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:30:55.330144    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb132d8c8_2160_4dd4_ae8a_8bf037850031.slice/crio-39f47d583abac3e4703abb4765e82037c3aa75687b6b2bcf466a0175bea65d81 WatchSource:0}: Error finding container 39f47d583abac3e4703abb4765e82037c3aa75687b6b2bcf466a0175bea65d81: Status 404 returned error can't find the container with id 39f47d583abac3e4703abb4765e82037c3aa75687b6b2bcf466a0175bea65d81
Jul 14 16:30:55.489917 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:30:55.489878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wj6gc" event={"ID":"b132d8c8-2160-4dd4-ae8a-8bf037850031","Type":"ContainerStarted","Data":"39f47d583abac3e4703abb4765e82037c3aa75687b6b2bcf466a0175bea65d81"}
Jul 14 16:31:00.504525 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:00.504490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wj6gc" event={"ID":"b132d8c8-2160-4dd4-ae8a-8bf037850031","Type":"ContainerStarted","Data":"f61129fc5398ace1cadacab178e23e2bd88de1c88e5923dd0f9957c5c205e419"}
Jul 14 16:31:00.504938 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:00.504565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wj6gc" event={"ID":"b132d8c8-2160-4dd4-ae8a-8bf037850031","Type":"ContainerStarted","Data":"3f5480c41f1d753daae6a078b5a76361f16d92fc5fe7e050e513f4475e511d6f"}
Jul 14 16:31:00.504938 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:00.504608    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:31:00.533288 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:00.533241    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wj6gc" podStartSLOduration=9.25752597 podStartE2EDuration="13.533226508s" totalImagesPullingTime="4.275700538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:00.532689754 +0000 UTC m=+49.662673954" watchObservedRunningTime="2026-07-14 16:31:00.533226508 +0000 UTC m=+49.663210707"
Jul 14 16:31:03.187371 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:03.187332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:31:03.187790 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:03.187393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:31:03.188020 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:03.187998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:31:03.189776 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:03.189752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7af01769-5d4f-4abf-9c9f-8123d4f5b03e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gslgw\" (UID: \"7af01769-5d4f-4abf-9c9f-8123d4f5b03e\") " pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:31:03.231828 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:03.231794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gslgw"
Jul 14 16:31:03.385665 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:03.385620    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gslgw"]
Jul 14 16:31:03.388721 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:03.388682    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af01769_5d4f_4abf_9c9f_8123d4f5b03e.slice/crio-a58f55f2e866059769f34cfe19afb4415bf34fec7355e6029fcb3d0fcc31a4f0 WatchSource:0}: Error finding container a58f55f2e866059769f34cfe19afb4415bf34fec7355e6029fcb3d0fcc31a4f0: Status 404 returned error can't find the container with id a58f55f2e866059769f34cfe19afb4415bf34fec7355e6029fcb3d0fcc31a4f0
Jul 14 16:31:03.513884 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:03.513853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gslgw" event={"ID":"7af01769-5d4f-4abf-9c9f-8123d4f5b03e","Type":"ContainerStarted","Data":"a58f55f2e866059769f34cfe19afb4415bf34fec7355e6029fcb3d0fcc31a4f0"}
Jul 14 16:31:07.533832 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:07.533797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gslgw" event={"ID":"7af01769-5d4f-4abf-9c9f-8123d4f5b03e","Type":"ContainerStarted","Data":"ccb804da47ae351f9e006e31b4191379ebfc6cd901b882c2e326488f382c3b4c"}
Jul 14 16:31:10.022343 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.022309    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"]
Jul 14 16:31:10.034068 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.034041    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"]
Jul 14 16:31:10.034208 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.034133    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.037310 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.037067    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 14 16:31:10.037464 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.037397    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 16:31:10.037682 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.037547    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 16:31:10.037795 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.037694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 16:31:10.038825 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.038802    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2p57h\""
Jul 14 16:31:10.047419 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.046518    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"]
Jul 14 16:31:10.047539 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.047500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.051648 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.051606    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 14 16:31:10.056885 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.056859    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"]
Jul 14 16:31:10.056991 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.056898    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"]
Jul 14 16:31:10.056991 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.056919    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"]
Jul 14 16:31:10.056991 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.056976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.063097 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.063075    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 14 16:31:10.063265 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.063245    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 14 16:31:10.063351 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.063256    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 14 16:31:10.073127 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.073110    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 14 16:31:10.138038 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f39cd1cf-add0-4ae5-92a8-a557030a1f73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b4d4dd98-cz82p\" (UID: \"f39cd1cf-add0-4ae5-92a8-a557030a1f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.138038 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-klusterlet-config\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.138291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkl97\" (UniqueName: \"kubernetes.io/projected/f39cd1cf-add0-4ae5-92a8-a557030a1f73-kube-api-access-kkl97\") pod \"managed-serviceaccount-addon-agent-69b4d4dd98-cz82p\" (UID: \"f39cd1cf-add0-4ae5-92a8-a557030a1f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.138291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4q4b\" (UniqueName: \"kubernetes.io/projected/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-kube-api-access-c4q4b\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.138291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knv7z\" (UniqueName: \"kubernetes.io/projected/6a92fab6-ff45-464b-90a0-ab6adfa8e385-kube-api-access-knv7z\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.138291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-tmp\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.138291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a92fab6-ff45-464b-90a0-ab6adfa8e385-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.138455 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.138455 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-hub\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.138455 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138364    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-ca\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.138455 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.138398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.238830 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.238806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-ca\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.238932 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.238844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.238932 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.238864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f39cd1cf-add0-4ae5-92a8-a557030a1f73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b4d4dd98-cz82p\" (UID: \"f39cd1cf-add0-4ae5-92a8-a557030a1f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.238932 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.238883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-klusterlet-config\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.238932 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.238917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkl97\" (UniqueName: \"kubernetes.io/projected/f39cd1cf-add0-4ae5-92a8-a557030a1f73-kube-api-access-kkl97\") pod \"managed-serviceaccount-addon-agent-69b4d4dd98-cz82p\" (UID: \"f39cd1cf-add0-4ae5-92a8-a557030a1f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.239121 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.239009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4q4b\" (UniqueName: \"kubernetes.io/projected/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-kube-api-access-c4q4b\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.239121 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.239051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knv7z\" (UniqueName: \"kubernetes.io/projected/6a92fab6-ff45-464b-90a0-ab6adfa8e385-kube-api-access-knv7z\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.239121 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.239082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-tmp\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.239268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.239131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a92fab6-ff45-464b-90a0-ab6adfa8e385-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.239268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.239169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.239268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.239222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-hub\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.239575 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.239551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-tmp\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.240085 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.240054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a92fab6-ff45-464b-90a0-ab6adfa8e385-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.241553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.241525    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-hub\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.241679 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.241640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-klusterlet-config\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.241754 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.241716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-ca\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.241857 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.241838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.241975 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.241955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f39cd1cf-add0-4ae5-92a8-a557030a1f73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b4d4dd98-cz82p\" (UID: \"f39cd1cf-add0-4ae5-92a8-a557030a1f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.242042 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.242027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a92fab6-ff45-464b-90a0-ab6adfa8e385-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.260902 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.260876    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkl97\" (UniqueName: \"kubernetes.io/projected/f39cd1cf-add0-4ae5-92a8-a557030a1f73-kube-api-access-kkl97\") pod \"managed-serviceaccount-addon-agent-69b4d4dd98-cz82p\" (UID: \"f39cd1cf-add0-4ae5-92a8-a557030a1f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.279519 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.279469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knv7z\" (UniqueName: \"kubernetes.io/projected/6a92fab6-ff45-464b-90a0-ab6adfa8e385-kube-api-access-knv7z\") pod \"cluster-proxy-proxy-agent-7959f7b765-vmh98\" (UID: \"6a92fab6-ff45-464b-90a0-ab6adfa8e385\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.286448 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.286427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4q4b\" (UniqueName: \"kubernetes.io/projected/b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a-kube-api-access-c4q4b\") pod \"klusterlet-addon-workmgr-665df6d79b-dvspl\" (UID: \"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.357847 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.357821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"
Jul 14 16:31:10.366935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.366911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:10.372073 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.372057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"
Jul 14 16:31:10.509865 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.509836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wj6gc"
Jul 14 16:31:10.516619 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.516591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p"]
Jul 14 16:31:10.521111 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:10.521081    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf39cd1cf_add0_4ae5_92a8_a557030a1f73.slice/crio-e589b5fcad53ef0d11b2d4276d95ffc75bf832ade518958fabf0b1b114ae47f1 WatchSource:0}: Error finding container e589b5fcad53ef0d11b2d4276d95ffc75bf832ade518958fabf0b1b114ae47f1: Status 404 returned error can't find the container with id e589b5fcad53ef0d11b2d4276d95ffc75bf832ade518958fabf0b1b114ae47f1
Jul 14 16:31:10.542957 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.542885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p" event={"ID":"f39cd1cf-add0-4ae5-92a8-a557030a1f73","Type":"ContainerStarted","Data":"e589b5fcad53ef0d11b2d4276d95ffc75bf832ade518958fabf0b1b114ae47f1"}
Jul 14 16:31:10.545094 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.545066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gslgw" event={"ID":"7af01769-5d4f-4abf-9c9f-8123d4f5b03e","Type":"ContainerStarted","Data":"5a43f37eba8cc54052713da603fbaadadf7f3e1ffc2793419306596883205876"}
Jul 14 16:31:10.552540 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.552515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"]
Jul 14 16:31:10.553792 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:10.553771    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70a0244_8cd1_4e5f_ace3_5f2c325e9e2a.slice/crio-997de068dd25c907cf83bf29428d2b4dda4a588669a28370013adbc33cc72e93 WatchSource:0}: Error finding container 997de068dd25c907cf83bf29428d2b4dda4a588669a28370013adbc33cc72e93: Status 404 returned error can't find the container with id 997de068dd25c907cf83bf29428d2b4dda4a588669a28370013adbc33cc72e93
Jul 14 16:31:10.570618 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:10.570599    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98"]
Jul 14 16:31:10.573637 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:10.573592    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a92fab6_ff45_464b_90a0_ab6adfa8e385.slice/crio-117eb083cc380a90d5108fa2aa395aff67c7274c9524f712e0d4889edf4b8da8 WatchSource:0}: Error finding container 117eb083cc380a90d5108fa2aa395aff67c7274c9524f712e0d4889edf4b8da8: Status 404 returned error can't find the container with id 117eb083cc380a90d5108fa2aa395aff67c7274c9524f712e0d4889edf4b8da8
Jul 14 16:31:11.552713 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:11.552613    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl" event={"ID":"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a","Type":"ContainerStarted","Data":"997de068dd25c907cf83bf29428d2b4dda4a588669a28370013adbc33cc72e93"}
Jul 14 16:31:11.554375 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:11.554303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98" event={"ID":"6a92fab6-ff45-464b-90a0-ab6adfa8e385","Type":"ContainerStarted","Data":"117eb083cc380a90d5108fa2aa395aff67c7274c9524f712e0d4889edf4b8da8"}
Jul 14 16:31:12.470981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:12.470944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq5"
Jul 14 16:31:17.576888 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.576796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p" event={"ID":"f39cd1cf-add0-4ae5-92a8-a557030a1f73","Type":"ContainerStarted","Data":"ee98d994dc52fa3128872fb62c8848d13af98d4b68e4cbc404903e5b7e6579ad"}
Jul 14 16:31:17.579047 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.579012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gslgw" event={"ID":"7af01769-5d4f-4abf-9c9f-8123d4f5b03e","Type":"ContainerStarted","Data":"32e2f6e52871b675d615c3bc545561c61e750a21290887e66283fec7764851cc"}
Jul 14 16:31:17.580985 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.580961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98" event={"ID":"6a92fab6-ff45-464b-90a0-ab6adfa8e385","Type":"ContainerStarted","Data":"8ccdb3124817dddd1adeefa438c262085e682afcd10eec6dd648da1aa013ad21"}
Jul 14 16:31:17.581088 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.580998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98" event={"ID":"6a92fab6-ff45-464b-90a0-ab6adfa8e385","Type":"ContainerStarted","Data":"6af739d617618ea6c6fcbf30607a5c4cd61173d49fcd46ee971a68e4c8ffe3d2"}
Jul 14 16:31:17.581088 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.581016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98" event={"ID":"6a92fab6-ff45-464b-90a0-ab6adfa8e385","Type":"ContainerStarted","Data":"1a84e6878fee68be902d910ad1ca5302cc85e9c71ab6ee9631791260429bd8c5"}
Jul 14 16:31:17.582298 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.582273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl" event={"ID":"b70a0244-8cd1-4e5f-ace3-5f2c325e9e2a","Type":"ContainerStarted","Data":"9fece503dda73ed0fa76e7aef30269c5b978317600e4cb906f04d5fde51bde6d"}
Jul 14 16:31:17.582478 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.582462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:17.584031 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.584014    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl"
Jul 14 16:31:17.595060 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.595018    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b4d4dd98-cz82p" podStartSLOduration=0.849545448 podStartE2EDuration="7.595005404s" totalImagesPullingTime="6.745459956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:17.594461309 +0000 UTC m=+66.724445510" watchObservedRunningTime="2026-07-14 16:31:17.595005404 +0000 UTC m=+66.724989603"
Jul 14 16:31:17.615110 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.615067    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gslgw" podStartSLOduration=16.927994109 podStartE2EDuration="30.615054037s" totalImagesPullingTime="13.687059928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:17.614273823 +0000 UTC m=+66.744258023" watchObservedRunningTime="2026-07-14 16:31:17.615054037 +0000 UTC m=+66.745038234"
Jul 14 16:31:17.632858 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.632821    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665df6d79b-dvspl" podStartSLOduration=0.89716357 podStartE2EDuration="7.632808131s" totalImagesPullingTime="6.735644561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:17.631883033 +0000 UTC m=+66.761867227" watchObservedRunningTime="2026-07-14 16:31:17.632808131 +0000 UTC m=+66.762792353"
Jul 14 16:31:17.656493 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.656450    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7959f7b765-vmh98" podStartSLOduration=0.941566768 podStartE2EDuration="7.656436323s" totalImagesPullingTime="6.714869555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:17.655802683 +0000 UTC m=+66.785786905" watchObservedRunningTime="2026-07-14 16:31:17.656436323 +0000 UTC m=+66.786420525"
Jul 14 16:31:17.907740 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.907642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:31:17.907740 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.907721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:31:17.911288 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.911264    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 16:31:17.911385 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.911294    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 16:31:17.920929 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.920906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa5c33ea-b97d-43b0-b2c0-cb13816e0284-original-pull-secret\") pod \"global-pull-secret-syncer-ngd5g\" (UID: \"aa5c33ea-b97d-43b0-b2c0-cb13816e0284\") " pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:31:17.920929 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.920917    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f943647-1be4-438f-8064-b91942486841-metrics-certs\") pod \"network-metrics-daemon-vpvnl\" (UID: \"6f943647-1be4-438f-8064-b91942486841\") " pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:31:17.926855 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:17.926836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ngd5g"
Jul 14 16:31:18.030248 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.030221    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2hfc\""
Jul 14 16:31:18.037867 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.037844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpvnl"
Jul 14 16:31:18.049728 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.049706    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ngd5g"]
Jul 14 16:31:18.052582 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:18.052554    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5c33ea_b97d_43b0_b2c0_cb13816e0284.slice/crio-c354004a8a5d3291400228527f046b3f50ff1790cf718e1d07cd44bdb2ee6946 WatchSource:0}: Error finding container c354004a8a5d3291400228527f046b3f50ff1790cf718e1d07cd44bdb2ee6946: Status 404 returned error can't find the container with id c354004a8a5d3291400228527f046b3f50ff1790cf718e1d07cd44bdb2ee6946
Jul 14 16:31:18.109004 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.108965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:31:18.111939 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.111919    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 16:31:18.122997 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.122961    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 16:31:18.134758 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.133258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnb9v\" (UniqueName: \"kubernetes.io/projected/cbebe223-6528-45a4-aa1f-6ca892d038b1-kube-api-access-tnb9v\") pod \"network-check-target-gvx6q\" (UID: \"cbebe223-6528-45a4-aa1f-6ca892d038b1\") " pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:31:18.165041 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.164974    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vpvnl"]
Jul 14 16:31:18.167900 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:18.167862    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f943647_1be4_438f_8064_b91942486841.slice/crio-3f849adc5d0cf51ed088267dddc2efd285756ec5bb939f0d8d1b876d531909ae WatchSource:0}: Error finding container 3f849adc5d0cf51ed088267dddc2efd285756ec5bb939f0d8d1b876d531909ae: Status 404 returned error can't find the container with id 3f849adc5d0cf51ed088267dddc2efd285756ec5bb939f0d8d1b876d531909ae
Jul 14 16:31:18.324994 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.324967    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cr5gm\""
Jul 14 16:31:18.332403 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.332384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:31:18.453588 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.453519    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvx6q"]
Jul 14 16:31:18.456771 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:18.456742    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbebe223_6528_45a4_aa1f_6ca892d038b1.slice/crio-f1cc40d9d25ae453709c640b1c3fda6a1a0d1a161cb4b1dfc379630003985db9 WatchSource:0}: Error finding container f1cc40d9d25ae453709c640b1c3fda6a1a0d1a161cb4b1dfc379630003985db9: Status 404 returned error can't find the container with id f1cc40d9d25ae453709c640b1c3fda6a1a0d1a161cb4b1dfc379630003985db9
Jul 14 16:31:18.587296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.587261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvx6q" event={"ID":"cbebe223-6528-45a4-aa1f-6ca892d038b1","Type":"ContainerStarted","Data":"f1cc40d9d25ae453709c640b1c3fda6a1a0d1a161cb4b1dfc379630003985db9"}
Jul 14 16:31:18.588642 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.588601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vpvnl" event={"ID":"6f943647-1be4-438f-8064-b91942486841","Type":"ContainerStarted","Data":"3f849adc5d0cf51ed088267dddc2efd285756ec5bb939f0d8d1b876d531909ae"}
Jul 14 16:31:18.589938 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:18.589898    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ngd5g" event={"ID":"aa5c33ea-b97d-43b0-b2c0-cb13816e0284","Type":"ContainerStarted","Data":"c354004a8a5d3291400228527f046b3f50ff1790cf718e1d07cd44bdb2ee6946"}
Jul 14 16:31:23.609348 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:23.609308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvx6q" event={"ID":"cbebe223-6528-45a4-aa1f-6ca892d038b1","Type":"ContainerStarted","Data":"5bbd6c63e8ce0efadef51b05199989c6d39095ce144c1f57341a1803f647ff9c"}
Jul 14 16:31:23.609813 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:23.609403    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:31:23.610931 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:23.610899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ngd5g" event={"ID":"aa5c33ea-b97d-43b0-b2c0-cb13816e0284","Type":"ContainerStarted","Data":"f7b1f9e5d16d03ddcc2d047463aed30fd22bbae729d646e93a924bfdf24aa742"}
Jul 14 16:31:23.628159 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:23.628108    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gvx6q" podStartSLOduration=66.695200726 podStartE2EDuration="1m11.628093497s" totalImagesPullingTime="4.932892771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:23.62782431 +0000 UTC m=+72.757808511" watchObservedRunningTime="2026-07-14 16:31:23.628093497 +0000 UTC m=+72.758077676"
Jul 14 16:31:23.645875 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:23.645787    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ngd5g" podStartSLOduration=66.297245431 podStartE2EDuration="1m11.64576839s" totalImagesPullingTime="5.348522959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:23.644716258 +0000 UTC m=+72.774700461" watchObservedRunningTime="2026-07-14 16:31:23.64576839 +0000 UTC m=+72.775752591"
Jul 14 16:31:24.616701 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:24.616661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vpvnl" event={"ID":"6f943647-1be4-438f-8064-b91942486841","Type":"ContainerStarted","Data":"64b03c2dc303ca9a3c890b8d59db6eedd569068a118681fcc058d2c1b3143a3a"}
Jul 14 16:31:24.617125 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:24.616724    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vpvnl" event={"ID":"6f943647-1be4-438f-8064-b91942486841","Type":"ContainerStarted","Data":"e0e0936f7428fa56a66f7dce0c83d7092fdfbe3d2c3acc960dc3cf49e6e19191"}
Jul 14 16:31:24.651258 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:24.651216    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vpvnl" podStartSLOduration=67.075998206 podStartE2EDuration="1m12.651200283s" totalImagesPullingTime="5.575202077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:24.651078948 +0000 UTC m=+73.781063150" watchObservedRunningTime="2026-07-14 16:31:24.651200283 +0000 UTC m=+73.781184482"
Jul 14 16:31:25.322727 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.322615    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"]
Jul 14 16:31:25.324772 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.324756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.336531 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.336510    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 16:31:25.337381 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.337364    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 16:31:25.337471 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.337368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 16:31:25.337726 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.337710    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 16:31:25.337726 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.337723    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-st7dc\""
Jul 14 16:31:25.337850 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.337727    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 16:31:25.352177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.352149    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"]
Jul 14 16:31:25.362364 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.362342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b824155-9e82-4beb-a22f-3defb5ee8b4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.362477 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.362378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm5ct\" (UniqueName: \"kubernetes.io/projected/0b824155-9e82-4beb-a22f-3defb5ee8b4b-kube-api-access-mm5ct\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.362517 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.362473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b824155-9e82-4beb-a22f-3defb5ee8b4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.362565 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.362548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b824155-9e82-4beb-a22f-3defb5ee8b4b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.419445 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.419415    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vlb6d"]
Jul 14 16:31:25.421638 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.421604    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.425633 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.425611    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hmsg7\""
Jul 14 16:31:25.426029 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.426012    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 16:31:25.426159 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.426144    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 16:31:25.428193 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.428175    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 16:31:25.463157 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-accelerators-collector-config\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz64h\" (UniqueName: \"kubernetes.io/projected/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-kube-api-access-dz64h\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-root\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-textfile\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b824155-9e82-4beb-a22f-3defb5ee8b4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.463412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm5ct\" (UniqueName: \"kubernetes.io/projected/0b824155-9e82-4beb-a22f-3defb5ee8b4b-kube-api-access-mm5ct\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.463412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-wtmp\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-sys\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-metrics-client-ca\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463717 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-tls\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.463717 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b824155-9e82-4beb-a22f-3defb5ee8b4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.463717 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.463518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b824155-9e82-4beb-a22f-3defb5ee8b4b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.464211 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.464195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b824155-9e82-4beb-a22f-3defb5ee8b4b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.465742 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.465720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b824155-9e82-4beb-a22f-3defb5ee8b4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.465839 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.465823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b824155-9e82-4beb-a22f-3defb5ee8b4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.473498 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.473475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm5ct\" (UniqueName: \"kubernetes.io/projected/0b824155-9e82-4beb-a22f-3defb5ee8b4b-kube-api-access-mm5ct\") pod \"openshift-state-metrics-84bd68b896-vwtzr\" (UID: \"0b824155-9e82-4beb-a22f-3defb5ee8b4b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.564073 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564073 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz64h\" (UniqueName: \"kubernetes.io/projected/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-kube-api-access-dz64h\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-root\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-textfile\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-root\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-wtmp\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-sys\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-metrics-client-ca\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-tls\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-textfile\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-wtmp\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564412    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-sys\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-accelerators-collector-config\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:31:25.564489    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 16:31:25.564553 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:31:25.564551    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-tls podName:9f4cd8ca-3ea8-493e-91ff-f0201e965c74 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:26.06453256 +0000 UTC m=+75.194516741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-tls") pod "node-exporter-vlb6d" (UID: "9f4cd8ca-3ea8-493e-91ff-f0201e965c74") : secret "node-exporter-tls" not found
Jul 14 16:31:25.564991 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-metrics-client-ca\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.564991 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.564945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-accelerators-collector-config\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.566348 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.566329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.579365 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.579314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz64h\" (UniqueName: \"kubernetes.io/projected/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-kube-api-access-dz64h\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:25.632739 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.632715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"
Jul 14 16:31:25.771151 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:25.771122    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr"]
Jul 14 16:31:25.774193 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:25.774169    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b824155_9e82_4beb_a22f_3defb5ee8b4b.slice/crio-874b2a190b96cf189645156142665af46accdf9ad8549e02aa059c6919eb6c4f WatchSource:0}: Error finding container 874b2a190b96cf189645156142665af46accdf9ad8549e02aa059c6919eb6c4f: Status 404 returned error can't find the container with id 874b2a190b96cf189645156142665af46accdf9ad8549e02aa059c6919eb6c4f
Jul 14 16:31:26.067719 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:26.067677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-tls\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:26.069927 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:26.069899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f4cd8ca-3ea8-493e-91ff-f0201e965c74-node-exporter-tls\") pod \"node-exporter-vlb6d\" (UID: \"9f4cd8ca-3ea8-493e-91ff-f0201e965c74\") " pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:26.329721 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:26.329689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vlb6d"
Jul 14 16:31:26.338766 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:26.338741    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4cd8ca_3ea8_493e_91ff_f0201e965c74.slice/crio-5427e4abb8fc5857a2d280af66ebffd8cbde7ef1f34faba325247e8449c52b4d WatchSource:0}: Error finding container 5427e4abb8fc5857a2d280af66ebffd8cbde7ef1f34faba325247e8449c52b4d: Status 404 returned error can't find the container with id 5427e4abb8fc5857a2d280af66ebffd8cbde7ef1f34faba325247e8449c52b4d
Jul 14 16:31:26.625470 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:26.625370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlb6d" event={"ID":"9f4cd8ca-3ea8-493e-91ff-f0201e965c74","Type":"ContainerStarted","Data":"5427e4abb8fc5857a2d280af66ebffd8cbde7ef1f34faba325247e8449c52b4d"}
Jul 14 16:31:26.627072 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:26.627049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr" event={"ID":"0b824155-9e82-4beb-a22f-3defb5ee8b4b","Type":"ContainerStarted","Data":"fea80b2c320524739d5b59570146dae5781d136caeff6e67f08bcdd2adceed26"}
Jul 14 16:31:26.627161 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:26.627097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr" event={"ID":"0b824155-9e82-4beb-a22f-3defb5ee8b4b","Type":"ContainerStarted","Data":"ffa6dec7893ca405f487f0d922f421afc457570d6d9998649e32f8e77a7a6c73"}
Jul 14 16:31:26.627161 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:26.627114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr" event={"ID":"0b824155-9e82-4beb-a22f-3defb5ee8b4b","Type":"ContainerStarted","Data":"874b2a190b96cf189645156142665af46accdf9ad8549e02aa059c6919eb6c4f"}
Jul 14 16:31:27.637352 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:27.637318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr" event={"ID":"0b824155-9e82-4beb-a22f-3defb5ee8b4b","Type":"ContainerStarted","Data":"289d5cf3e57f735b083dafa5fc3c59c9f69c68d28379a5b290605bd3ca23a740"}
Jul 14 16:31:27.693374 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:27.693321    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vwtzr" podStartSLOduration=1.100838165 podStartE2EDuration="2.693306216s" totalImagesPullingTime="1.592468051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:27.691093185 +0000 UTC m=+76.821077386" watchObservedRunningTime="2026-07-14 16:31:27.693306216 +0000 UTC m=+76.823290415"
Jul 14 16:31:29.646540 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:29.646505    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f4cd8ca-3ea8-493e-91ff-f0201e965c74" containerID="3e7a53b7cc81f382ce53f23dd00578608f14a55a9f8e90adf7d465992d813fb4" exitCode=0
Jul 14 16:31:29.646964 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:29.646597    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlb6d" event={"ID":"9f4cd8ca-3ea8-493e-91ff-f0201e965c74","Type":"ContainerDied","Data":"3e7a53b7cc81f382ce53f23dd00578608f14a55a9f8e90adf7d465992d813fb4"}
Jul 14 16:31:30.651938 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:30.651902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlb6d" event={"ID":"9f4cd8ca-3ea8-493e-91ff-f0201e965c74","Type":"ContainerStarted","Data":"f51b499d10245016e7a4b751cf72bcb9451ff5f49771e6caea9dc6bc04e2078a"}
Jul 14 16:31:30.652323 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:30.651957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlb6d" event={"ID":"9f4cd8ca-3ea8-493e-91ff-f0201e965c74","Type":"ContainerStarted","Data":"928342fa6de8399261a0c0af12ad65bced0178fbb3e9aef5520a298013c84438"}
Jul 14 16:31:30.699401 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:30.699356    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vlb6d" podStartSLOduration=2.9224199410000002 podStartE2EDuration="5.699321331s" totalImagesPullingTime="2.712120434s" totalInitContainerRuntime="64.780956ms" isStatefulPod=true podCreationTimestamp="2026-07-14 16:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:30.697953551 +0000 UTC m=+79.827937751" watchObservedRunningTime="2026-07-14 16:31:30.699321331 +0000 UTC m=+79.829305525"
Jul 14 16:31:32.051800 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.051768    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:31:32.054231 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.054214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.065853 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.065829    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 16:31:32.065935 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.065848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 16:31:32.067140 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.067125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 16:31:32.067193 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.067175    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 16:31:32.067362 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.067349    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-71rk2e0ih2cr7\""
Jul 14 16:31:32.069057 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.069043    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 16:31:32.070882 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.070866    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 16:31:32.082179 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.082156    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 16:31:32.082300 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.082197    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wqlqt\""
Jul 14 16:31:32.082300 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.082216    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 16:31:32.082388 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.082350    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 16:31:32.082909 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.082895    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 16:31:32.083079 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.083067    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 16:31:32.083128 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.083118    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 16:31:32.083181 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.083122    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 16:31:32.083233 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.083202    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 16:31:32.086471 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.086456    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 16:31:32.095296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.095270    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:31:32.116207 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-web-config\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116304 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-config\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116304 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116304 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116304 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116523 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116523 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116523 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116523 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmzzm\" (UniqueName: \"kubernetes.io/projected/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-kube-api-access-xmzzm\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-config-out\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116861 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116861 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116861 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116861 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116861 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.116861 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.116832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217457 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-web-config\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217457 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-config\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217670 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217670 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217670 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217670 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217869 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217869 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217869 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217869 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.217869 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmzzm\" (UniqueName: \"kubernetes.io/projected/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-kube-api-access-xmzzm\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-config-out\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.217985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.218012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.218039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.218072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.218105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218543 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.218415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218543 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.218415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.218662 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.218638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.220225 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.219161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.220225 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.219875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.220225 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.219927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.220225 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.220175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.221872 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.221822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.221996 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.221968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.222357 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.222302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.222812 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.222787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-web-config\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.222958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.222934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.223086 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.223065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-config-out\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.223168 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.223115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.223250 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.223223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.223357 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.223323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-config\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.223418 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.223395    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.223835 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.223816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.224127 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.224111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.241970 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.241952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmzzm\" (UniqueName: \"kubernetes.io/projected/64c0a9af-03fc-4e0d-b28c-3e9036e89b58-kube-api-access-xmzzm\") pod \"prometheus-k8s-0\" (UID: \"64c0a9af-03fc-4e0d-b28c-3e9036e89b58\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.366965 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.366895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:32.549739 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.549159    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:31:32.553733 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:31:32.553706    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c0a9af_03fc_4e0d_b28c_3e9036e89b58.slice/crio-3f48f50e9258a04442b1713d0d961f624c2d9e80f4a43699a24c4d2ccc5bce31 WatchSource:0}: Error finding container 3f48f50e9258a04442b1713d0d961f624c2d9e80f4a43699a24c4d2ccc5bce31: Status 404 returned error can't find the container with id 3f48f50e9258a04442b1713d0d961f624c2d9e80f4a43699a24c4d2ccc5bce31
Jul 14 16:31:32.659639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:32.659552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"3f48f50e9258a04442b1713d0d961f624c2d9e80f4a43699a24c4d2ccc5bce31"}
Jul 14 16:31:33.664865 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:33.664839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"53ee3191dcbf20fc0b871c20cc86123882867cf4429b2a4f0955480a75b2de93"}
Jul 14 16:31:34.671033 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:34.670997    2576 generic.go:356] "Generic (PLEG): container finished" podID="64c0a9af-03fc-4e0d-b28c-3e9036e89b58" containerID="53ee3191dcbf20fc0b871c20cc86123882867cf4429b2a4f0955480a75b2de93" exitCode=0
Jul 14 16:31:34.671506 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:34.671062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerDied","Data":"53ee3191dcbf20fc0b871c20cc86123882867cf4429b2a4f0955480a75b2de93"}
Jul 14 16:31:37.689428 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:37.689388    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"8afa493cb7fe278302b036f2baa946f0594140b679489266ee67fa0a92319641"}
Jul 14 16:31:37.689861 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:37.689491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"aa5d082e019d337d405b02f3e5460c76d5743ef4882b467a2e26d9028cefef77"}
Jul 14 16:31:39.699005 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:39.698971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"5f6874624672d7953d5c284548846624e01cdc341141650182a1000f8fe755cc"}
Jul 14 16:31:39.699381 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:39.699039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"41a5ce215b5819c071cc886eb33d2bdbb2706633d2e9d7ebca2e40ecbd81a19a"}
Jul 14 16:31:39.699381 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:39.699067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"54ed62d5db89474c4cc1c1bc41668838c4913997465fc604c9499641e5c5795a"}
Jul 14 16:31:39.699381 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:39.699102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64c0a9af-03fc-4e0d-b28c-3e9036e89b58","Type":"ContainerStarted","Data":"643fca07f34e45b1764f6b4e088377a66481aa319db0c23160d8ffd10dddfcbf"}
Jul 14 16:31:39.760318 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:39.760265    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.803402616 podStartE2EDuration="8.76024901s" totalImagesPullingTime="5.938441896s" totalInitContainerRuntime="18.404498ms" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:39.759415656 +0000 UTC m=+88.889399928" watchObservedRunningTime="2026-07-14 16:31:39.76024901 +0000 UTC m=+88.890233210"
Jul 14 16:31:42.367402 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:42.367369    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:31:54.619807 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:31:54.619775    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gvx6q"
Jul 14 16:32:32.368131 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:32:32.368085    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:32:32.389576 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:32:32.389546    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:32:32.911073 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:32:32.911049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:35:12.105108 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:12.105081    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 16:35:14.881876 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.881847    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"]
Jul 14 16:35:14.885021 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.885006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:14.889604 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.889586    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 16:35:14.890071 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.890053    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 16:35:14.890499 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.890486    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 16:35:14.892597 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.892576    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bkcjj\""
Jul 14 16:35:14.892764 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.892746    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 16:35:14.915577 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:14.915555    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"]
Jul 14 16:35:15.038402 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.038370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.038552 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.038410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.038552 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.038435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8kq\" (UniqueName: \"kubernetes.io/projected/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-kube-api-access-gg8kq\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.038552 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.038454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.038552 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.038513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.139509 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.139429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.139509 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.139473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.139509 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.139494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8kq\" (UniqueName: \"kubernetes.io/projected/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-kube-api-access-gg8kq\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.139509 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.139513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.139757 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.139532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.139955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.139936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.141830 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.141800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.141934 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.141919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.142004 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.141988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.152724 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.152705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8kq\" (UniqueName: \"kubernetes.io/projected/bc56f196-b2b3-43a2-bc8d-30d8ebe41019-kube-api-access-gg8kq\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn\" (UID: \"bc56f196-b2b3-43a2-bc8d-30d8ebe41019\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.195283 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.195266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:15.337660 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.337613    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"]
Jul 14 16:35:15.341192 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:35:15.341162    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc56f196_b2b3_43a2_bc8d_30d8ebe41019.slice/crio-71607af8928a7424efd5fdd76b127eebd8764771b9c0456e4b399ec2fd863668 WatchSource:0}: Error finding container 71607af8928a7424efd5fdd76b127eebd8764771b9c0456e4b399ec2fd863668: Status 404 returned error can't find the container with id 71607af8928a7424efd5fdd76b127eebd8764771b9c0456e4b399ec2fd863668
Jul 14 16:35:15.342863 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.342848    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:35:15.417727 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:15.417665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn" event={"ID":"bc56f196-b2b3-43a2-bc8d-30d8ebe41019","Type":"ContainerStarted","Data":"71607af8928a7424efd5fdd76b127eebd8764771b9c0456e4b399ec2fd863668"}
Jul 14 16:35:19.435164 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:19.435125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn" event={"ID":"bc56f196-b2b3-43a2-bc8d-30d8ebe41019","Type":"ContainerStarted","Data":"70a4397bafc867461d2d7dcfc8cc2c366727902e7965fcae6b3933c5b645f1a0"}
Jul 14 16:35:20.440992 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:20.440950    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc56f196-b2b3-43a2-bc8d-30d8ebe41019" containerID="70a4397bafc867461d2d7dcfc8cc2c366727902e7965fcae6b3933c5b645f1a0" exitCode=0
Jul 14 16:35:20.441370 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:20.441013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn" event={"ID":"bc56f196-b2b3-43a2-bc8d-30d8ebe41019","Type":"ContainerDied","Data":"70a4397bafc867461d2d7dcfc8cc2c366727902e7965fcae6b3933c5b645f1a0"}
Jul 14 16:35:21.447788 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:21.447743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn" event={"ID":"bc56f196-b2b3-43a2-bc8d-30d8ebe41019","Type":"ContainerStarted","Data":"a573882f7cb50ef312b7b780b0b25525e0668e0d1ae76a14d4e3b111fab4a8f2"}
Jul 14 16:35:21.448173 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:21.447895    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:21.497878 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:21.497830    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn" podStartSLOduration=2.846218485 podStartE2EDuration="7.49781341s" totalImagesPullingTime="3.578036979s" totalInitContainerRuntime="1.073557946s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:21.495820791 +0000 UTC m=+310.625804992" watchObservedRunningTime="2026-07-14 16:35:21.49781341 +0000 UTC m=+310.627797609"
Jul 14 16:35:32.453207 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:32.453171    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn"
Jul 14 16:35:35.741139 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.741101    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rk4x6"]
Jul 14 16:35:35.744930 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.744900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:35.758200 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.758177    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 14 16:35:35.758200 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.758177    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mm7ff\""
Jul 14 16:35:35.781080 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.781042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rk4x6"]
Jul 14 16:35:35.785274 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.785250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b356a9-867a-42db-999f-f69c9a2b6411-cert\") pod \"odh-model-controller-7998c67dc4-rk4x6\" (UID: \"f0b356a9-867a-42db-999f-f69c9a2b6411\") " pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:35.785406 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.785305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cbq\" (UniqueName: \"kubernetes.io/projected/f0b356a9-867a-42db-999f-f69c9a2b6411-kube-api-access-f6cbq\") pod \"odh-model-controller-7998c67dc4-rk4x6\" (UID: \"f0b356a9-867a-42db-999f-f69c9a2b6411\") " pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:35.886530 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.886492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cbq\" (UniqueName: \"kubernetes.io/projected/f0b356a9-867a-42db-999f-f69c9a2b6411-kube-api-access-f6cbq\") pod \"odh-model-controller-7998c67dc4-rk4x6\" (UID: \"f0b356a9-867a-42db-999f-f69c9a2b6411\") " pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:35.886717 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.886538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b356a9-867a-42db-999f-f69c9a2b6411-cert\") pod \"odh-model-controller-7998c67dc4-rk4x6\" (UID: \"f0b356a9-867a-42db-999f-f69c9a2b6411\") " pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:35.886717 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:35.886652    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 14 16:35:35.886717 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:35.886717    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b356a9-867a-42db-999f-f69c9a2b6411-cert podName:f0b356a9-867a-42db-999f-f69c9a2b6411 nodeName:}" failed. No retries permitted until 2026-07-14 16:35:36.386699366 +0000 UTC m=+325.516683544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f0b356a9-867a-42db-999f-f69c9a2b6411-cert") pod "odh-model-controller-7998c67dc4-rk4x6" (UID: "f0b356a9-867a-42db-999f-f69c9a2b6411") : secret "odh-model-controller-webhook-cert" not found
Jul 14 16:35:35.920898 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:35.920863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cbq\" (UniqueName: \"kubernetes.io/projected/f0b356a9-867a-42db-999f-f69c9a2b6411-kube-api-access-f6cbq\") pod \"odh-model-controller-7998c67dc4-rk4x6\" (UID: \"f0b356a9-867a-42db-999f-f69c9a2b6411\") " pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:36.390232 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:36.390202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b356a9-867a-42db-999f-f69c9a2b6411-cert\") pod \"odh-model-controller-7998c67dc4-rk4x6\" (UID: \"f0b356a9-867a-42db-999f-f69c9a2b6411\") " pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:36.392682 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:36.392658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b356a9-867a-42db-999f-f69c9a2b6411-cert\") pod \"odh-model-controller-7998c67dc4-rk4x6\" (UID: \"f0b356a9-867a-42db-999f-f69c9a2b6411\") " pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:36.655663 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:36.655542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:36.807873 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:36.807835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rk4x6"]
Jul 14 16:35:36.816644 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:35:36.816605    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b356a9_867a_42db_999f_f69c9a2b6411.slice/crio-1fcc6073ea61064d1d79ca6aebf5ffe9d6f0c16c1d051451d23aafd7afd87446 WatchSource:0}: Error finding container 1fcc6073ea61064d1d79ca6aebf5ffe9d6f0c16c1d051451d23aafd7afd87446: Status 404 returned error can't find the container with id 1fcc6073ea61064d1d79ca6aebf5ffe9d6f0c16c1d051451d23aafd7afd87446
Jul 14 16:35:37.277515 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.277470    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z96dt"]
Jul 14 16:35:37.282128 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.282109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:37.288533 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.288508    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mdbzk\""
Jul 14 16:35:37.288751 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.288730    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 14 16:35:37.295700 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.295672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2548f1-2fa7-4f57-832f-51688e9d276f-tls-certs\") pod \"model-serving-api-54d89bd5fc-z96dt\" (UID: \"4c2548f1-2fa7-4f57-832f-51688e9d276f\") " pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:37.295810 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.295723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8hvb\" (UniqueName: \"kubernetes.io/projected/4c2548f1-2fa7-4f57-832f-51688e9d276f-kube-api-access-g8hvb\") pod \"model-serving-api-54d89bd5fc-z96dt\" (UID: \"4c2548f1-2fa7-4f57-832f-51688e9d276f\") " pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:37.310242 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.310219    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z96dt"]
Jul 14 16:35:37.397157 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.397121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2548f1-2fa7-4f57-832f-51688e9d276f-tls-certs\") pod \"model-serving-api-54d89bd5fc-z96dt\" (UID: \"4c2548f1-2fa7-4f57-832f-51688e9d276f\") " pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:37.397316 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.397177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8hvb\" (UniqueName: \"kubernetes.io/projected/4c2548f1-2fa7-4f57-832f-51688e9d276f-kube-api-access-g8hvb\") pod \"model-serving-api-54d89bd5fc-z96dt\" (UID: \"4c2548f1-2fa7-4f57-832f-51688e9d276f\") " pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:37.397316 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:37.397265    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 14 16:35:37.397401 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:37.397324    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2548f1-2fa7-4f57-832f-51688e9d276f-tls-certs podName:4c2548f1-2fa7-4f57-832f-51688e9d276f nodeName:}" failed. No retries permitted until 2026-07-14 16:35:37.897308255 +0000 UTC m=+327.027292438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4c2548f1-2fa7-4f57-832f-51688e9d276f-tls-certs") pod "model-serving-api-54d89bd5fc-z96dt" (UID: "4c2548f1-2fa7-4f57-832f-51688e9d276f") : secret "model-serving-api-tls" not found
Jul 14 16:35:37.416977 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.416945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8hvb\" (UniqueName: \"kubernetes.io/projected/4c2548f1-2fa7-4f57-832f-51688e9d276f-kube-api-access-g8hvb\") pod \"model-serving-api-54d89bd5fc-z96dt\" (UID: \"4c2548f1-2fa7-4f57-832f-51688e9d276f\") " pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:37.502683 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.502647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6" event={"ID":"f0b356a9-867a-42db-999f-f69c9a2b6411","Type":"ContainerStarted","Data":"1fcc6073ea61064d1d79ca6aebf5ffe9d6f0c16c1d051451d23aafd7afd87446"}
Jul 14 16:35:37.901005 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.900969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2548f1-2fa7-4f57-832f-51688e9d276f-tls-certs\") pod \"model-serving-api-54d89bd5fc-z96dt\" (UID: \"4c2548f1-2fa7-4f57-832f-51688e9d276f\") " pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:37.904218 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:37.904176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2548f1-2fa7-4f57-832f-51688e9d276f-tls-certs\") pod \"model-serving-api-54d89bd5fc-z96dt\" (UID: \"4c2548f1-2fa7-4f57-832f-51688e9d276f\") " pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:38.193016 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:38.192930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:38.366840 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:38.366756    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z96dt"]
Jul 14 16:35:38.371772 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:35:38.371737    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2548f1_2fa7_4f57_832f_51688e9d276f.slice/crio-5c96d5e5c0b640e4936f2f95315f8de379798819e5192d9e5d2fde512cc97d1e WatchSource:0}: Error finding container 5c96d5e5c0b640e4936f2f95315f8de379798819e5192d9e5d2fde512cc97d1e: Status 404 returned error can't find the container with id 5c96d5e5c0b640e4936f2f95315f8de379798819e5192d9e5d2fde512cc97d1e
Jul 14 16:35:38.510544 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:38.510506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z96dt" event={"ID":"4c2548f1-2fa7-4f57-832f-51688e9d276f","Type":"ContainerStarted","Data":"5c96d5e5c0b640e4936f2f95315f8de379798819e5192d9e5d2fde512cc97d1e"}
Jul 14 16:35:41.085879 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.085846    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"]
Jul 14 16:35:41.088928 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.088911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.092049 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.092029    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 16:35:41.092354 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.092337    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 16:35:41.092443 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.092402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 16:35:41.093236 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.093220    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7gslv\""
Jul 14 16:35:41.093236 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.093230    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 16:35:41.107113 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.107089    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"]
Jul 14 16:35:41.131330 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.131248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.131330 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.131281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tmp\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.131330 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.131313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pjjr\" (UniqueName: \"kubernetes.io/projected/d30c1a98-0f07-47ef-9340-1bc3de03a68d-kube-api-access-8pjjr\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.232150 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.232101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.232150 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.232143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tmp\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.232412 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.232190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pjjr\" (UniqueName: \"kubernetes.io/projected/d30c1a98-0f07-47ef-9340-1bc3de03a68d-kube-api-access-8pjjr\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.232412 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:41.232261    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 14 16:35:41.232412 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:41.232326    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tls-certs podName:d30c1a98-0f07-47ef-9340-1bc3de03a68d nodeName:}" failed. No retries permitted until 2026-07-14 16:35:41.732304675 +0000 UTC m=+330.862288857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tls-certs") pod "kube-auth-proxy-7f68dcd7b8-7w7b8" (UID: "d30c1a98-0f07-47ef-9340-1bc3de03a68d") : secret "kube-auth-proxy-tls" not found
Jul 14 16:35:41.234591 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.234564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tmp\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.246937 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.246905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pjjr\" (UniqueName: \"kubernetes.io/projected/d30c1a98-0f07-47ef-9340-1bc3de03a68d-kube-api-access-8pjjr\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.526697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.526663    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6" event={"ID":"f0b356a9-867a-42db-999f-f69c9a2b6411","Type":"ContainerStarted","Data":"7ed8f2934877e047b7067b97a584c87969b83cea3a97452f58d4f7b1675b2e22"}
Jul 14 16:35:41.526895 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.526777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:41.528206 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.528186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z96dt" event={"ID":"4c2548f1-2fa7-4f57-832f-51688e9d276f","Type":"ContainerStarted","Data":"c0425b98fded9de9141ed8d4836b7e7c16e6f0f2978f49b4288e4926b509bc60"}
Jul 14 16:35:41.528302 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.528234    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:41.548316 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.548257    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6" podStartSLOduration=2.500559859 podStartE2EDuration="6.548234506s" totalImagesPullingTime="4.047674647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:41.546777502 +0000 UTC m=+330.676761704" watchObservedRunningTime="2026-07-14 16:35:41.548234506 +0000 UTC m=+330.678218707"
Jul 14 16:35:41.737678 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.737643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.740588 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.740559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d30c1a98-0f07-47ef-9340-1bc3de03a68d-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-7w7b8\" (UID: \"d30c1a98-0f07-47ef-9340-1bc3de03a68d\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:41.999082 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:41.999053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"
Jul 14 16:35:42.140439 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.140384    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-z96dt" podStartSLOduration=2.650232257 podStartE2EDuration="5.140364963s" totalImagesPullingTime="2.490132706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:41.58617268 +0000 UTC m=+330.716156893" watchObservedRunningTime="2026-07-14 16:35:42.140364963 +0000 UTC m=+331.270349174"
Jul 14 16:35:42.141697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.141668    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8"]
Jul 14 16:35:42.144782 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:35:42.144755    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30c1a98_0f07_47ef_9340_1bc3de03a68d.slice/crio-971c3715d1628023d2d518d763cecb19b0861b9e682b86965124a510f6cc8c7a WatchSource:0}: Error finding container 971c3715d1628023d2d518d763cecb19b0861b9e682b86965124a510f6cc8c7a: Status 404 returned error can't find the container with id 971c3715d1628023d2d518d763cecb19b0861b9e682b86965124a510f6cc8c7a
Jul 14 16:35:42.533404 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.533356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8" event={"ID":"d30c1a98-0f07-47ef-9340-1bc3de03a68d","Type":"ContainerStarted","Data":"971c3715d1628023d2d518d763cecb19b0861b9e682b86965124a510f6cc8c7a"}
Jul 14 16:35:42.869654 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.869559    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"]
Jul 14 16:35:42.873908 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.873888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:42.877966 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.877946    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 16:35:42.878071 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.877947    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 16:35:42.878520 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.878500    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 16:35:42.878638 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.878533    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-brsbg\""
Jul 14 16:35:42.881770 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.881751    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 16:35:42.899906 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.899881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"]
Jul 14 16:35:42.949507 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.949474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:42.949693 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.949515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfcnl\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-kube-api-access-lfcnl\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:42.949693 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.949544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-cacerts\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:42.949693 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.949664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:42.949827 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.949705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/739c4b16-9101-442f-9c10-ffc92a0587dc-local-certs\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:42.949827 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.949769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-token\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:42.949827 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:42.949812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.050389 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.050353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.050389 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.050388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/739c4b16-9101-442f-9c10-ffc92a0587dc-local-certs\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.050739 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.050419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-token\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.050739 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.050441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.050739 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.050473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.050739 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.050497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfcnl\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-kube-api-access-lfcnl\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.050739 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.050515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-cacerts\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.051144 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.051108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.052775 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.052746    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/739c4b16-9101-442f-9c10-ffc92a0587dc-local-certs\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.053074 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.053049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.053275 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.053257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-cacerts\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.053337 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.053285    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.063022 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.062994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-token\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.064068 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.064048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfcnl\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-kube-api-access-lfcnl\") pod \"istiod-openshift-gateway-7574459656-phbb6\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.183857 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.183776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:43.321561 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.321539    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"]
Jul 14 16:35:43.324280 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:35:43.324255    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739c4b16_9101_442f_9c10_ffc92a0587dc.slice/crio-90774b1029cfa12c6cac720f0b3d902db8be2de05aa6fa7b552e4a6a3c0a4205 WatchSource:0}: Error finding container 90774b1029cfa12c6cac720f0b3d902db8be2de05aa6fa7b552e4a6a3c0a4205: Status 404 returned error can't find the container with id 90774b1029cfa12c6cac720f0b3d902db8be2de05aa6fa7b552e4a6a3c0a4205
Jul 14 16:35:43.539018 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:43.538986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6" event={"ID":"739c4b16-9101-442f-9c10-ffc92a0587dc","Type":"ContainerStarted","Data":"90774b1029cfa12c6cac720f0b3d902db8be2de05aa6fa7b552e4a6a3c0a4205"}
Jul 14 16:35:45.551464 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:45.551428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8" event={"ID":"d30c1a98-0f07-47ef-9340-1bc3de03a68d","Type":"ContainerStarted","Data":"40b7877dd5b3690f7995bbbce3c06b3c9375dd4c43d111dd6b92780db4fdf08f"}
Jul 14 16:35:45.579097 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:45.579040    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-7w7b8" podStartSLOduration=1.277146167 podStartE2EDuration="4.579019252s" totalImagesPullingTime="3.301873085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:45.576048802 +0000 UTC m=+334.706033003" watchObservedRunningTime="2026-07-14 16:35:45.579019252 +0000 UTC m=+334.709003453"
Jul 14 16:35:47.862555 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.862513    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"]
Jul 14 16:35:47.870923 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.870896    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:47.875661 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.875640    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qlmhj\""
Jul 14 16:35:47.880161 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.880136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 16:35:47.882084 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.882060    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"]
Jul 14 16:35:47.886987 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.886968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:47.895382 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.894345    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 16:35:47.895382 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.894694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-np8gb\""
Jul 14 16:35:47.900421 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.900396    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"]
Jul 14 16:35:47.904268 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.904244    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"]
Jul 14 16:35:47.993281 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.993233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87p6\" (UniqueName: \"kubernetes.io/projected/2a58127c-721c-478b-8eea-1b07081782da-kube-api-access-z87p6\") pod \"llmisvc-controller-manager-777c6bd7d5-cm7zf\" (UID: \"2a58127c-721c-478b-8eea-1b07081782da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:47.993468 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.993303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8db53a08-7cc8-48be-a4e2-7f77dc56d12d-cert\") pod \"kserve-controller-manager-d6f4b65b8-d6ldf\" (UID: \"8db53a08-7cc8-48be-a4e2-7f77dc56d12d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:47.993468 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.993343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xzn\" (UniqueName: \"kubernetes.io/projected/8db53a08-7cc8-48be-a4e2-7f77dc56d12d-kube-api-access-d9xzn\") pod \"kserve-controller-manager-d6f4b65b8-d6ldf\" (UID: \"8db53a08-7cc8-48be-a4e2-7f77dc56d12d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:47.993468 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:47.993361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a58127c-721c-478b-8eea-1b07081782da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cm7zf\" (UID: \"2a58127c-721c-478b-8eea-1b07081782da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:48.094324 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.094293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87p6\" (UniqueName: \"kubernetes.io/projected/2a58127c-721c-478b-8eea-1b07081782da-kube-api-access-z87p6\") pod \"llmisvc-controller-manager-777c6bd7d5-cm7zf\" (UID: \"2a58127c-721c-478b-8eea-1b07081782da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:48.094465 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.094355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8db53a08-7cc8-48be-a4e2-7f77dc56d12d-cert\") pod \"kserve-controller-manager-d6f4b65b8-d6ldf\" (UID: \"8db53a08-7cc8-48be-a4e2-7f77dc56d12d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:48.094465 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.094397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xzn\" (UniqueName: \"kubernetes.io/projected/8db53a08-7cc8-48be-a4e2-7f77dc56d12d-kube-api-access-d9xzn\") pod \"kserve-controller-manager-d6f4b65b8-d6ldf\" (UID: \"8db53a08-7cc8-48be-a4e2-7f77dc56d12d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:48.094465 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.094427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a58127c-721c-478b-8eea-1b07081782da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cm7zf\" (UID: \"2a58127c-721c-478b-8eea-1b07081782da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:48.094612 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.094491    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 14 16:35:48.094612 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:48.094572    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 14 16:35:48.094612 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.094575    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 14 16:35:48.094791 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:48.094649    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a58127c-721c-478b-8eea-1b07081782da-cert podName:2a58127c-721c-478b-8eea-1b07081782da nodeName:}" failed. No retries permitted until 2026-07-14 16:35:48.594611943 +0000 UTC m=+337.724596144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a58127c-721c-478b-8eea-1b07081782da-cert") pod "llmisvc-controller-manager-777c6bd7d5-cm7zf" (UID: "2a58127c-721c-478b-8eea-1b07081782da") : secret "llmisvc-webhook-server-cert" not found
Jul 14 16:35:48.096983 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.096959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8db53a08-7cc8-48be-a4e2-7f77dc56d12d-cert\") pod \"kserve-controller-manager-d6f4b65b8-d6ldf\" (UID: \"8db53a08-7cc8-48be-a4e2-7f77dc56d12d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:48.112895 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.112868    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87p6\" (UniqueName: \"kubernetes.io/projected/2a58127c-721c-478b-8eea-1b07081782da-kube-api-access-z87p6\") pod \"llmisvc-controller-manager-777c6bd7d5-cm7zf\" (UID: \"2a58127c-721c-478b-8eea-1b07081782da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:48.114606 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.114581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xzn\" (UniqueName: \"kubernetes.io/projected/8db53a08-7cc8-48be-a4e2-7f77dc56d12d-kube-api-access-d9xzn\") pod \"kserve-controller-manager-d6f4b65b8-d6ldf\" (UID: \"8db53a08-7cc8-48be-a4e2-7f77dc56d12d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:48.184619 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.184581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:48.367559 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.367480    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"]
Jul 14 16:35:48.370369 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:35:48.370341    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db53a08_7cc8_48be_a4e2_7f77dc56d12d.slice/crio-7240f9e76cd956b1f0f61acaf356b309453d27811b9b030be65b6a2c7972681d WatchSource:0}: Error finding container 7240f9e76cd956b1f0f61acaf356b309453d27811b9b030be65b6a2c7972681d: Status 404 returned error can't find the container with id 7240f9e76cd956b1f0f61acaf356b309453d27811b9b030be65b6a2c7972681d
Jul 14 16:35:48.565473 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.565433    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6" event={"ID":"739c4b16-9101-442f-9c10-ffc92a0587dc","Type":"ContainerStarted","Data":"ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f"}
Jul 14 16:35:48.565655 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.565494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:48.566702 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.566675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf" event={"ID":"8db53a08-7cc8-48be-a4e2-7f77dc56d12d","Type":"ContainerStarted","Data":"7240f9e76cd956b1f0f61acaf356b309453d27811b9b030be65b6a2c7972681d"}
Jul 14 16:35:48.596334 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.596276    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6" podStartSLOduration=1.828231502 podStartE2EDuration="6.596259198s" totalImagesPullingTime="4.768027696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:48.595318033 +0000 UTC m=+337.725302247" watchObservedRunningTime="2026-07-14 16:35:48.596259198 +0000 UTC m=+337.726243398"
Jul 14 16:35:48.598766 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.598731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a58127c-721c-478b-8eea-1b07081782da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cm7zf\" (UID: \"2a58127c-721c-478b-8eea-1b07081782da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:48.601550 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.601526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a58127c-721c-478b-8eea-1b07081782da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cm7zf\" (UID: \"2a58127c-721c-478b-8eea-1b07081782da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:48.799308 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.799275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:48.959192 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:35:48.959158    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2a58127c_721c_478b_8eea_1b07081782da.slice/crio-51a6565c7ee344633e3349475bce5a24062f2373a759781aa694eeba55590b2e WatchSource:0}: Error finding container 51a6565c7ee344633e3349475bce5a24062f2373a759781aa694eeba55590b2e: Status 404 returned error can't find the container with id 51a6565c7ee344633e3349475bce5a24062f2373a759781aa694eeba55590b2e
Jul 14 16:35:48.962118 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:48.962095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"]
Jul 14 16:35:49.574001 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:49.573916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf" event={"ID":"2a58127c-721c-478b-8eea-1b07081782da","Type":"ContainerStarted","Data":"51a6565c7ee344633e3349475bce5a24062f2373a759781aa694eeba55590b2e"}
Jul 14 16:35:49.575620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:49.575591    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-phbb6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:35:49.575764 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:49.575666    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6" podUID="739c4b16-9101-442f-9c10-ffc92a0587dc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:35:52.536234 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.536200    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rk4x6"
Jul 14 16:35:52.538470 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.538449    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-z96dt"
Jul 14 16:35:52.550390 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.550367    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"]
Jul 14 16:35:52.550524 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.550504    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6" podUID="739c4b16-9101-442f-9c10-ffc92a0587dc" containerName="discovery" containerID="cri-o://ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f" gracePeriod=30
Jul 14 16:35:52.551260 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.551196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:52.589855 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.589818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf" event={"ID":"8db53a08-7cc8-48be-a4e2-7f77dc56d12d","Type":"ContainerStarted","Data":"76c0e7eff476d2517891a2a4f4c9e1694612f852ced28c162f330d8650535413"}
Jul 14 16:35:52.590039 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.589884    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:35:52.801220 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.801169    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf" podStartSLOduration=2.972277277 podStartE2EDuration="5.801146687s" totalImagesPullingTime="2.82886941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:52.799044483 +0000 UTC m=+341.929028684" watchObservedRunningTime="2026-07-14 16:35:52.801146687 +0000 UTC m=+341.931130889"
Jul 14 16:35:52.815152 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.815124    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:52.936068 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.936034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-kubeconfig\") pod \"739c4b16-9101-442f-9c10-ffc92a0587dc\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") "
Jul 14 16:35:52.936249 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.936082    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/739c4b16-9101-442f-9c10-ffc92a0587dc-local-certs\") pod \"739c4b16-9101-442f-9c10-ffc92a0587dc\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") "
Jul 14 16:35:52.936249 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.936136    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-dns-cert\") pod \"739c4b16-9101-442f-9c10-ffc92a0587dc\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") "
Jul 14 16:35:52.936249 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.936197    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfcnl\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-kube-api-access-lfcnl\") pod \"739c4b16-9101-442f-9c10-ffc92a0587dc\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") "
Jul 14 16:35:52.936417 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.936319    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-cacerts\") pod \"739c4b16-9101-442f-9c10-ffc92a0587dc\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") "
Jul 14 16:35:52.936417 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.936368    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-ca-configmap\") pod \"739c4b16-9101-442f-9c10-ffc92a0587dc\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") "
Jul 14 16:35:52.936516 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.936418    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-token\") pod \"739c4b16-9101-442f-9c10-ffc92a0587dc\" (UID: \"739c4b16-9101-442f-9c10-ffc92a0587dc\") "
Jul 14 16:35:52.937405 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.937318    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "739c4b16-9101-442f-9c10-ffc92a0587dc" (UID: "739c4b16-9101-442f-9c10-ffc92a0587dc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:35:52.939878 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.939676    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "739c4b16-9101-442f-9c10-ffc92a0587dc" (UID: "739c4b16-9101-442f-9c10-ffc92a0587dc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:35:52.940422 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.940360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "739c4b16-9101-442f-9c10-ffc92a0587dc" (UID: "739c4b16-9101-442f-9c10-ffc92a0587dc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:35:52.940422 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.940294    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/739c4b16-9101-442f-9c10-ffc92a0587dc-local-certs" (OuterVolumeSpecName: "local-certs") pod "739c4b16-9101-442f-9c10-ffc92a0587dc" (UID: "739c4b16-9101-442f-9c10-ffc92a0587dc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:35:52.940571 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.940454    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-kube-api-access-lfcnl" (OuterVolumeSpecName: "kube-api-access-lfcnl") pod "739c4b16-9101-442f-9c10-ffc92a0587dc" (UID: "739c4b16-9101-442f-9c10-ffc92a0587dc"). InnerVolumeSpecName "kube-api-access-lfcnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:35:52.940571 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.940482    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "739c4b16-9101-442f-9c10-ffc92a0587dc" (UID: "739c4b16-9101-442f-9c10-ffc92a0587dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:35:52.940779 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:52.940571    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-cacerts" (OuterVolumeSpecName: "cacerts") pod "739c4b16-9101-442f-9c10-ffc92a0587dc" (UID: "739c4b16-9101-442f-9c10-ffc92a0587dc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:35:53.037450 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.037409    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-ca-configmap\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:35:53.037450 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.037443    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-token\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:35:53.037450 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.037453    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-kubeconfig\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:35:53.037450 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.037461    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/739c4b16-9101-442f-9c10-ffc92a0587dc-local-certs\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:35:53.037729 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.037471    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-istio-csr-dns-cert\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:35:53.037729 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.037479    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfcnl\" (UniqueName: \"kubernetes.io/projected/739c4b16-9101-442f-9c10-ffc92a0587dc-kube-api-access-lfcnl\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:35:53.037729 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.037489    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/739c4b16-9101-442f-9c10-ffc92a0587dc-cacerts\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:35:53.595041 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.595009    2576 generic.go:356] "Generic (PLEG): container finished" podID="739c4b16-9101-442f-9c10-ffc92a0587dc" containerID="ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f" exitCode=0
Jul 14 16:35:53.595434 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.595052    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"
Jul 14 16:35:53.595434 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.595087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6" event={"ID":"739c4b16-9101-442f-9c10-ffc92a0587dc","Type":"ContainerDied","Data":"ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f"}
Jul 14 16:35:53.595434 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.595149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-phbb6" event={"ID":"739c4b16-9101-442f-9c10-ffc92a0587dc","Type":"ContainerDied","Data":"90774b1029cfa12c6cac720f0b3d902db8be2de05aa6fa7b552e4a6a3c0a4205"}
Jul 14 16:35:53.595434 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.595180    2576 scope.go:117] "RemoveContainer" containerID="ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f"
Jul 14 16:35:53.596740 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.596716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf" event={"ID":"2a58127c-721c-478b-8eea-1b07081782da","Type":"ContainerStarted","Data":"6347510ac2e7c1a5090f574f95c09eb3de6a1512eb9df30da372ce07b2779797"}
Jul 14 16:35:53.596946 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.596918    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:35:53.603815 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.603792    2576 scope.go:117] "RemoveContainer" containerID="ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f"
Jul 14 16:35:53.604063 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:35:53.604042    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f\": container with ID starting with ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f not found: ID does not exist" containerID="ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f"
Jul 14 16:35:53.604132 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.604070    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f"} err="failed to get container status \"ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f\": rpc error: code = NotFound desc = could not find container \"ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f\": container with ID starting with ee1fa17b30857f6a1dba16024c9c55abb88473ad4a020c2def6c48bd791b840f not found: ID does not exist"
Jul 14 16:35:53.620541 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.620495    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf" podStartSLOduration=2.141345137 podStartE2EDuration="6.620481319s" totalImagesPullingTime="4.479136182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:53.619526684 +0000 UTC m=+342.749510885" watchObservedRunningTime="2026-07-14 16:35:53.620481319 +0000 UTC m=+342.750465518"
Jul 14 16:35:53.640025 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.639995    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"]
Jul 14 16:35:53.641570 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:53.641548    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-phbb6"]
Jul 14 16:35:54.306573 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:35:54.306534    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="739c4b16-9101-442f-9c10-ffc92a0587dc" path="/var/lib/kubelet/pods/739c4b16-9101-442f-9c10-ffc92a0587dc/volumes"
Jul 14 16:36:23.601669 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:23.601633    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ldf"
Jul 14 16:36:24.604307 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:24.604275    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm7zf"
Jul 14 16:36:36.781994 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.781962    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z279n"]
Jul 14 16:36:36.782466 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.782245    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="739c4b16-9101-442f-9c10-ffc92a0587dc" containerName="discovery"
Jul 14 16:36:36.782466 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.782255    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="739c4b16-9101-442f-9c10-ffc92a0587dc" containerName="discovery"
Jul 14 16:36:36.782466 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.782314    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="739c4b16-9101-442f-9c10-ffc92a0587dc" containerName="discovery"
Jul 14 16:36:36.784303 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.784284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:36.788966 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.788942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9xsmr\""
Jul 14 16:36:36.789813 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.789796    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 16:36:36.790805 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.790784    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 16:36:36.866366 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.866330    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z279n"]
Jul 14 16:36:36.884167 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.884133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65sxq\" (UniqueName: \"kubernetes.io/projected/9759d3b9-eaef-44c5-8d05-fcfa4dceee23-kube-api-access-65sxq\") pod \"kuadrant-operator-catalog-z279n\" (UID: \"9759d3b9-eaef-44c5-8d05-fcfa4dceee23\") " pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:36.985475 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:36.985440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65sxq\" (UniqueName: \"kubernetes.io/projected/9759d3b9-eaef-44c5-8d05-fcfa4dceee23-kube-api-access-65sxq\") pod \"kuadrant-operator-catalog-z279n\" (UID: \"9759d3b9-eaef-44c5-8d05-fcfa4dceee23\") " pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:37.030804 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:37.030773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65sxq\" (UniqueName: \"kubernetes.io/projected/9759d3b9-eaef-44c5-8d05-fcfa4dceee23-kube-api-access-65sxq\") pod \"kuadrant-operator-catalog-z279n\" (UID: \"9759d3b9-eaef-44c5-8d05-fcfa4dceee23\") " pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:37.093021 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:37.092921    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:37.282397 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:37.282372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z279n"]
Jul 14 16:36:37.284854 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:36:37.284829    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9759d3b9_eaef_44c5_8d05_fcfa4dceee23.slice/crio-282f10b7270c8ceec6d46b107b4eae946196042ea103ec3a2a1029e02c7d2433 WatchSource:0}: Error finding container 282f10b7270c8ceec6d46b107b4eae946196042ea103ec3a2a1029e02c7d2433: Status 404 returned error can't find the container with id 282f10b7270c8ceec6d46b107b4eae946196042ea103ec3a2a1029e02c7d2433
Jul 14 16:36:37.777290 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:37.777259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z279n" event={"ID":"9759d3b9-eaef-44c5-8d05-fcfa4dceee23","Type":"ContainerStarted","Data":"282f10b7270c8ceec6d46b107b4eae946196042ea103ec3a2a1029e02c7d2433"}
Jul 14 16:36:40.792040 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:40.792002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z279n" event={"ID":"9759d3b9-eaef-44c5-8d05-fcfa4dceee23","Type":"ContainerStarted","Data":"db146e2190c95df2d27395185de301695a3cfc62aa1840950dee9f805d5b4b2e"}
Jul 14 16:36:47.093298 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:47.093261    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:47.093875 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:47.093324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:47.115970 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:47.115940    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:36:47.145586 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:47.145535    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z279n" podStartSLOduration=8.601381737 podStartE2EDuration="11.145519094s" totalImagesPullingTime="2.544137357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:36:40.820980163 +0000 UTC m=+389.950964387" watchObservedRunningTime="2026-07-14 16:36:47.145519094 +0000 UTC m=+396.275503294"
Jul 14 16:36:47.843277 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:36:47.843251    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-z279n"
Jul 14 16:37:02.641343 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.641306    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"]
Jul 14 16:37:02.645715 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.645692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"
Jul 14 16:37:02.653888 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.653869    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 14 16:37:02.656553 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.656533    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-44tj8\""
Jul 14 16:37:02.657949 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.657925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"]
Jul 14 16:37:02.698493 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.698459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpgdl\" (UniqueName: \"kubernetes.io/projected/05c0e85e-428b-4be3-803b-02e862c919af-kube-api-access-wpgdl\") pod \"dns-operator-controller-manager-864dd78c4c-kjqpz\" (UID: \"05c0e85e-428b-4be3-803b-02e862c919af\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"
Jul 14 16:37:02.799554 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.799517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpgdl\" (UniqueName: \"kubernetes.io/projected/05c0e85e-428b-4be3-803b-02e862c919af-kube-api-access-wpgdl\") pod \"dns-operator-controller-manager-864dd78c4c-kjqpz\" (UID: \"05c0e85e-428b-4be3-803b-02e862c919af\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"
Jul 14 16:37:02.813599 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.813571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpgdl\" (UniqueName: \"kubernetes.io/projected/05c0e85e-428b-4be3-803b-02e862c919af-kube-api-access-wpgdl\") pod \"dns-operator-controller-manager-864dd78c4c-kjqpz\" (UID: \"05c0e85e-428b-4be3-803b-02e862c919af\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"
Jul 14 16:37:02.955419 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:02.955327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"
Jul 14 16:37:03.113281 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:03.113163    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"]
Jul 14 16:37:03.116053 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:37:03.116030    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c0e85e_428b_4be3_803b_02e862c919af.slice/crio-6754b80756db21d337e57919514b7cd0c6350765faff03252dabe51256b7c5b3 WatchSource:0}: Error finding container 6754b80756db21d337e57919514b7cd0c6350765faff03252dabe51256b7c5b3: Status 404 returned error can't find the container with id 6754b80756db21d337e57919514b7cd0c6350765faff03252dabe51256b7c5b3
Jul 14 16:37:03.886535 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:03.886501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz" event={"ID":"05c0e85e-428b-4be3-803b-02e862c919af","Type":"ContainerStarted","Data":"6754b80756db21d337e57919514b7cd0c6350765faff03252dabe51256b7c5b3"}
Jul 14 16:37:05.895687 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:05.895579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz" event={"ID":"05c0e85e-428b-4be3-803b-02e862c919af","Type":"ContainerStarted","Data":"b2605971d6d710f2a3bc4947a706a305880fb0d0f77f7d663ce6c4673c26caef"}
Jul 14 16:37:05.895687 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:05.895675    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"
Jul 14 16:37:05.928029 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:05.927981    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz" podStartSLOduration=1.412331996 podStartE2EDuration="3.927966155s" totalImagesPullingTime="2.515634159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:05.927017478 +0000 UTC m=+415.057001688" watchObservedRunningTime="2026-07-14 16:37:05.927966155 +0000 UTC m=+415.057950355"
Jul 14 16:37:06.293364 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.293324    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"]
Jul 14 16:37:06.296607 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.296585    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:06.300076 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.300055    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-psm2x\""
Jul 14 16:37:06.363170 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.363142    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"]
Jul 14 16:37:06.428773 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.428739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwbrj\" (UniqueName: \"kubernetes.io/projected/b12627e3-54b2-4540-9575-32a34752e0a0-kube-api-access-hwbrj\") pod \"limitador-operator-controller-manager-859d7b78bd-csnww\" (UID: \"b12627e3-54b2-4540-9575-32a34752e0a0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:06.529307 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.529264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwbrj\" (UniqueName: \"kubernetes.io/projected/b12627e3-54b2-4540-9575-32a34752e0a0-kube-api-access-hwbrj\") pod \"limitador-operator-controller-manager-859d7b78bd-csnww\" (UID: \"b12627e3-54b2-4540-9575-32a34752e0a0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:06.554912 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.554847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwbrj\" (UniqueName: \"kubernetes.io/projected/b12627e3-54b2-4540-9575-32a34752e0a0-kube-api-access-hwbrj\") pod \"limitador-operator-controller-manager-859d7b78bd-csnww\" (UID: \"b12627e3-54b2-4540-9575-32a34752e0a0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:06.607029 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.606997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:06.743235 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.743204    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"]
Jul 14 16:37:06.746986 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:37:06.746958    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12627e3_54b2_4540_9575_32a34752e0a0.slice/crio-5c9ae6a2399996652633fff11def23e660a56e1fe863452e7222e5fb43e3f700 WatchSource:0}: Error finding container 5c9ae6a2399996652633fff11def23e660a56e1fe863452e7222e5fb43e3f700: Status 404 returned error can't find the container with id 5c9ae6a2399996652633fff11def23e660a56e1fe863452e7222e5fb43e3f700
Jul 14 16:37:06.901019 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:06.900938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww" event={"ID":"b12627e3-54b2-4540-9575-32a34752e0a0","Type":"ContainerStarted","Data":"5c9ae6a2399996652633fff11def23e660a56e1fe863452e7222e5fb43e3f700"}
Jul 14 16:37:08.911695 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:08.911588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww" event={"ID":"b12627e3-54b2-4540-9575-32a34752e0a0","Type":"ContainerStarted","Data":"af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4"}
Jul 14 16:37:08.912094 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:08.911727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:08.933734 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:08.933689    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww" podStartSLOduration=1.181692853 podStartE2EDuration="2.933660979s" totalImagesPullingTime="1.751968126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:08.933553403 +0000 UTC m=+418.063537619" watchObservedRunningTime="2026-07-14 16:37:08.933660979 +0000 UTC m=+418.063645178"
Jul 14 16:37:11.518721 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.518692    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"]
Jul 14 16:37:11.526339 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.526312    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.529116 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.529100    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfxsh\""
Jul 14 16:37:11.537113 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.537092    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"]
Jul 14 16:37:11.671784 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.671754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bqd\" (UniqueName: \"kubernetes.io/projected/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-kube-api-access-k9bqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.671933 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.671796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.772934 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.772864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.773091 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.772955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bqd\" (UniqueName: \"kubernetes.io/projected/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-kube-api-access-k9bqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.773223 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.773203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.783689 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.783662    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bqd\" (UniqueName: \"kubernetes.io/projected/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-kube-api-access-k9bqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.836444 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.836412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:11.974207 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:11.974159    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"]
Jul 14 16:37:11.977737 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:37:11.977711    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc743318_f8e5_46c4_a2c4_7e97ea1e17db.slice/crio-798f7f79cbe93fe71162b368de767d6123970d01fbee722325ca99a2d97ab1c3 WatchSource:0}: Error finding container 798f7f79cbe93fe71162b368de767d6123970d01fbee722325ca99a2d97ab1c3: Status 404 returned error can't find the container with id 798f7f79cbe93fe71162b368de767d6123970d01fbee722325ca99a2d97ab1c3
Jul 14 16:37:12.930291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:12.930254    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb" event={"ID":"fc743318-f8e5-46c4-a2c4-7e97ea1e17db","Type":"ContainerStarted","Data":"798f7f79cbe93fe71162b368de767d6123970d01fbee722325ca99a2d97ab1c3"}
Jul 14 16:37:15.442747 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.442711    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"]
Jul 14 16:37:15.446442 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.446416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"
Jul 14 16:37:15.449615 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.449597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lc8vv\""
Jul 14 16:37:15.460824 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.460802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"]
Jul 14 16:37:15.607074 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.607036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvfdq\" (UniqueName: \"kubernetes.io/projected/091922d3-0f1c-41c4-9185-962b30cc28bd-kube-api-access-rvfdq\") pod \"authorino-operator-75cc8d5cb7-w2lqb\" (UID: \"091922d3-0f1c-41c4-9185-962b30cc28bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"
Jul 14 16:37:15.708484 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.708405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvfdq\" (UniqueName: \"kubernetes.io/projected/091922d3-0f1c-41c4-9185-962b30cc28bd-kube-api-access-rvfdq\") pod \"authorino-operator-75cc8d5cb7-w2lqb\" (UID: \"091922d3-0f1c-41c4-9185-962b30cc28bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"
Jul 14 16:37:15.724590 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.724561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvfdq\" (UniqueName: \"kubernetes.io/projected/091922d3-0f1c-41c4-9185-962b30cc28bd-kube-api-access-rvfdq\") pod \"authorino-operator-75cc8d5cb7-w2lqb\" (UID: \"091922d3-0f1c-41c4-9185-962b30cc28bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"
Jul 14 16:37:15.759439 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.759403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"
Jul 14 16:37:15.900382 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.900252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"]
Jul 14 16:37:15.903023 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:37:15.902999    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091922d3_0f1c_41c4_9185_962b30cc28bd.slice/crio-053224ff5cfb38995623308f519c545657f3d38ce210ab95fcff92040a8de756 WatchSource:0}: Error finding container 053224ff5cfb38995623308f519c545657f3d38ce210ab95fcff92040a8de756: Status 404 returned error can't find the container with id 053224ff5cfb38995623308f519c545657f3d38ce210ab95fcff92040a8de756
Jul 14 16:37:15.944980 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:15.944949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb" event={"ID":"091922d3-0f1c-41c4-9185-962b30cc28bd","Type":"ContainerStarted","Data":"053224ff5cfb38995623308f519c545657f3d38ce210ab95fcff92040a8de756"}
Jul 14 16:37:16.903758 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:16.903723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kjqpz"
Jul 14 16:37:19.918069 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:19.918040    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:19.967552 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:19.967516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb" event={"ID":"091922d3-0f1c-41c4-9185-962b30cc28bd","Type":"ContainerStarted","Data":"c77288d941ad78381089724a6d9bb8cd7bb7af3dc1f30444c39ada7645b5aa6c"}
Jul 14 16:37:19.967748 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:19.967581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"
Jul 14 16:37:19.969164 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:19.969137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb" event={"ID":"fc743318-f8e5-46c4-a2c4-7e97ea1e17db","Type":"ContainerStarted","Data":"518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9"}
Jul 14 16:37:19.969288 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:19.969211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:19.989810 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:19.989768    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb" podStartSLOduration=1.4987722479999999 podStartE2EDuration="4.989753742s" totalImagesPullingTime="3.490981494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:19.988863066 +0000 UTC m=+429.118847289" watchObservedRunningTime="2026-07-14 16:37:19.989753742 +0000 UTC m=+429.119737942"
Jul 14 16:37:20.015652 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:20.015597    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb" podStartSLOduration=1.5938885900000002 podStartE2EDuration="9.015582219s" totalImagesPullingTime="7.421693629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:20.013435311 +0000 UTC m=+429.143419546" watchObservedRunningTime="2026-07-14 16:37:20.015582219 +0000 UTC m=+429.145566474"
Jul 14 16:37:30.976192 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:30.976158    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w2lqb"
Jul 14 16:37:30.976566 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:30.976271    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:32.839059 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.838964    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"]
Jul 14 16:37:32.843049 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.843025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:32.870715 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.870688    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"]
Jul 14 16:37:32.924763 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.924731    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"]
Jul 14 16:37:32.924973 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.924948    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" containerName="manager" containerID="cri-o://518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9" gracePeriod=2
Jul 14 16:37:32.926788 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.926761    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"]
Jul 14 16:37:32.930089 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:32.930018    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:32.942614 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.942440    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"]
Jul 14 16:37:32.942993 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:32.942936    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-b2l8g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5"
Jul 14 16:37:32.952365 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.952343    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"]
Jul 14 16:37:32.952620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.952600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2l8g\" (UniqueName: \"kubernetes.io/projected/b16ac76d-d812-43e9-948d-c3edb06412f5-kube-api-access-b2l8g\") pod \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" (UID: \"b16ac76d-d812-43e9-948d-c3edb06412f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:32.952730 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.952709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b16ac76d-d812-43e9-948d-c3edb06412f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" (UID: \"b16ac76d-d812-43e9-948d-c3edb06412f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:32.964118 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.964092    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"]
Jul 14 16:37:32.964299 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.964275    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" containerName="manager" containerID="cri-o://af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4" gracePeriod=2
Jul 14 16:37:32.978369 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.978343    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"]
Jul 14 16:37:32.986077 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.986050    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"]
Jul 14 16:37:32.986639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.986509    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" containerName="manager"
Jul 14 16:37:32.986639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.986531    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" containerName="manager"
Jul 14 16:37:32.986639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.986549    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" containerName="manager"
Jul 14 16:37:32.986639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.986558    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" containerName="manager"
Jul 14 16:37:32.986893 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.986697    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" containerName="manager"
Jul 14 16:37:32.986893 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.986714    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" containerName="manager"
Jul 14 16:37:32.989959 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:32.989943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.000837 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.000808    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b12627e3-54b2-4540-9575-32a34752e0a0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-csnww\": pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:33.003165 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.003132    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:33.005682 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.005659    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"]
Jul 14 16:37:33.005864 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.005836    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:33.008780 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.008762    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.012355 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.012329    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:33.013584 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.013553    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"]
Jul 14 16:37:33.023241 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.023219    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"]
Jul 14 16:37:33.024077 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.024028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.027023 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.027004    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"]
Jul 14 16:37:33.027122 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.027084    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"
Jul 14 16:37:33.041414 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.041392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"]
Jul 14 16:37:33.053117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.053093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b16ac76d-d812-43e9-948d-c3edb06412f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" (UID: \"b16ac76d-d812-43e9-948d-c3edb06412f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.053245 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.053189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2l8g\" (UniqueName: \"kubernetes.io/projected/b16ac76d-d812-43e9-948d-c3edb06412f5-kube-api-access-b2l8g\") pod \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" (UID: \"b16ac76d-d812-43e9-948d-c3edb06412f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.053508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.053483    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b16ac76d-d812-43e9-948d-c3edb06412f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" (UID: \"b16ac76d-d812-43e9-948d-c3edb06412f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.053898 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.053871    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:33.055275 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.055253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.056706 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.056678    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.061083 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.061065    2576 projected.go:196] Error preparing data for projected volume kube-api-access-b2l8g for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-h7lfz" not found
Jul 14 16:37:33.061165 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.061121    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b16ac76d-d812-43e9-948d-c3edb06412f5-kube-api-access-b2l8g podName:b16ac76d-d812-43e9-948d-c3edb06412f5 nodeName:}" failed. No retries permitted until 2026-07-14 16:37:33.561105925 +0000 UTC m=+442.691090103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b2l8g" (UniqueName: "kubernetes.io/projected/b16ac76d-d812-43e9-948d-c3edb06412f5-kube-api-access-b2l8g") pod "kuadrant-operator-controller-manager-86878c769f-h7lfz" (UID: "b16ac76d-d812-43e9-948d-c3edb06412f5") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-h7lfz" not found
Jul 14 16:37:33.122309 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.122214    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:33.128888 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.128850    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.131432 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.131324    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:33.135501 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.135474    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:33.154275 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.154247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmz4\" (UniqueName: \"kubernetes.io/projected/252aab24-45df-456e-8218-0cdabfc492d9-kube-api-access-6fmz4\") pod \"kuadrant-operator-controller-manager-86878c769f-k7crb\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.154375 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.154306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prhvk\" (UniqueName: \"kubernetes.io/projected/3db43a8e-19d4-4897-af3c-eff9e29b454a-kube-api-access-prhvk\") pod \"limitador-operator-controller-manager-859d7b78bd-s457m\" (UID: \"3db43a8e-19d4-4897-af3c-eff9e29b454a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"
Jul 14 16:37:33.154375 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.154329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93eae44c-94b7-4162-8848-b8a2162e9785-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fr9qn\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.154375 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.154348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252aab24-45df-456e-8218-0cdabfc492d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k7crb\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.154475 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.154391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldv2w\" (UniqueName: \"kubernetes.io/projected/93eae44c-94b7-4162-8848-b8a2162e9785-kube-api-access-ldv2w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fr9qn\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.210253 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.210221    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:33.213246 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.213227    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:33.213731 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.213703    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:33.216081 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.216058    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.218255 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.218236    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:33.221987 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.221966    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:33.224182 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.224162    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:33.226290 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:33.226271    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:33.255381 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255351    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b16ac76d-d812-43e9-948d-c3edb06412f5-extensions-socket-volume\") pod \"b16ac76d-d812-43e9-948d-c3edb06412f5\" (UID: \"b16ac76d-d812-43e9-948d-c3edb06412f5\") "
Jul 14 16:37:33.255512 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldv2w\" (UniqueName: \"kubernetes.io/projected/93eae44c-94b7-4162-8848-b8a2162e9785-kube-api-access-ldv2w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fr9qn\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.255576 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmz4\" (UniqueName: \"kubernetes.io/projected/252aab24-45df-456e-8218-0cdabfc492d9-kube-api-access-6fmz4\") pod \"kuadrant-operator-controller-manager-86878c769f-k7crb\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.255651 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prhvk\" (UniqueName: \"kubernetes.io/projected/3db43a8e-19d4-4897-af3c-eff9e29b454a-kube-api-access-prhvk\") pod \"limitador-operator-controller-manager-859d7b78bd-s457m\" (UID: \"3db43a8e-19d4-4897-af3c-eff9e29b454a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"
Jul 14 16:37:33.255651 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93eae44c-94b7-4162-8848-b8a2162e9785-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fr9qn\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.255651 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255593    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ac76d-d812-43e9-948d-c3edb06412f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b16ac76d-d812-43e9-948d-c3edb06412f5" (UID: "b16ac76d-d812-43e9-948d-c3edb06412f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:33.255794 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252aab24-45df-456e-8218-0cdabfc492d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k7crb\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.255794 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255756    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2l8g\" (UniqueName: \"kubernetes.io/projected/b16ac76d-d812-43e9-948d-c3edb06412f5-kube-api-access-b2l8g\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:37:33.255794 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255771    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b16ac76d-d812-43e9-948d-c3edb06412f5-extensions-socket-volume\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:37:33.255932 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.255915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93eae44c-94b7-4162-8848-b8a2162e9785-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fr9qn\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.256098 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.256078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252aab24-45df-456e-8218-0cdabfc492d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k7crb\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.271407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.271378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldv2w\" (UniqueName: \"kubernetes.io/projected/93eae44c-94b7-4162-8848-b8a2162e9785-kube-api-access-ldv2w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fr9qn\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.271407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.271391    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prhvk\" (UniqueName: \"kubernetes.io/projected/3db43a8e-19d4-4897-af3c-eff9e29b454a-kube-api-access-prhvk\") pod \"limitador-operator-controller-manager-859d7b78bd-s457m\" (UID: \"3db43a8e-19d4-4897-af3c-eff9e29b454a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"
Jul 14 16:37:33.271564 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.271419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmz4\" (UniqueName: \"kubernetes.io/projected/252aab24-45df-456e-8218-0cdabfc492d9-kube-api-access-6fmz4\") pod \"kuadrant-operator-controller-manager-86878c769f-k7crb\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.344329 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.344294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:33.352561 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.352540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:33.356581 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.356557    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwbrj\" (UniqueName: \"kubernetes.io/projected/b12627e3-54b2-4540-9575-32a34752e0a0-kube-api-access-hwbrj\") pod \"b12627e3-54b2-4540-9575-32a34752e0a0\" (UID: \"b12627e3-54b2-4540-9575-32a34752e0a0\") "
Jul 14 16:37:33.356690 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.356674    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-extensions-socket-volume\") pod \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") "
Jul 14 16:37:33.356765 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.356752    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9bqd\" (UniqueName: \"kubernetes.io/projected/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-kube-api-access-k9bqd\") pod \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\" (UID: \"fc743318-f8e5-46c4-a2c4-7e97ea1e17db\") "
Jul 14 16:37:33.357283 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.357252    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc743318-f8e5-46c4-a2c4-7e97ea1e17db" (UID: "fc743318-f8e5-46c4-a2c4-7e97ea1e17db"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:33.358917 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.358893    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-kube-api-access-k9bqd" (OuterVolumeSpecName: "kube-api-access-k9bqd") pod "fc743318-f8e5-46c4-a2c4-7e97ea1e17db" (UID: "fc743318-f8e5-46c4-a2c4-7e97ea1e17db"). InnerVolumeSpecName "kube-api-access-k9bqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:37:33.359022 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.359007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12627e3-54b2-4540-9575-32a34752e0a0-kube-api-access-hwbrj" (OuterVolumeSpecName: "kube-api-access-hwbrj") pod "b12627e3-54b2-4540-9575-32a34752e0a0" (UID: "b12627e3-54b2-4540-9575-32a34752e0a0"). InnerVolumeSpecName "kube-api-access-hwbrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:37:33.361160 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.361137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"
Jul 14 16:37:33.458045 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.457985    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9bqd\" (UniqueName: \"kubernetes.io/projected/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-kube-api-access-k9bqd\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:37:33.458045 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.458013    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwbrj\" (UniqueName: \"kubernetes.io/projected/b12627e3-54b2-4540-9575-32a34752e0a0-kube-api-access-hwbrj\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:37:33.458045 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.458023    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc743318-f8e5-46c4-a2c4-7e97ea1e17db-extensions-socket-volume\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:37:33.539863 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.539801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"]
Jul 14 16:37:33.542648 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:37:33.542609    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252aab24_45df_456e_8218_0cdabfc492d9.slice/crio-7b80fd41f30bf1f6668b8636a3b1942812fe32baa5d4a16325b0312953b0b20a WatchSource:0}: Error finding container 7b80fd41f30bf1f6668b8636a3b1942812fe32baa5d4a16325b0312953b0b20a: Status 404 returned error can't find the container with id 7b80fd41f30bf1f6668b8636a3b1942812fe32baa5d4a16325b0312953b0b20a
Jul 14 16:37:33.771990 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.771953    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"]
Jul 14 16:37:33.776521 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:33.776494    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"]
Jul 14 16:37:33.777341 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:37:33.777314    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db43a8e_19d4_4897_af3c_eff9e29b454a.slice/crio-2d076b0c7a829da30012aa1bb239ab697ba868e6bb06b160b4a81212b2111c6a WatchSource:0}: Error finding container 2d076b0c7a829da30012aa1bb239ab697ba868e6bb06b160b4a81212b2111c6a: Status 404 returned error can't find the container with id 2d076b0c7a829da30012aa1bb239ab697ba868e6bb06b160b4a81212b2111c6a
Jul 14 16:37:33.777840 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:37:33.777815    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93eae44c_94b7_4162_8848_b8a2162e9785.slice/crio-ea6c165ade29709c67dfa470a6b62c3461b9fa2b421720fa01cefb3ac69074be WatchSource:0}: Error finding container ea6c165ade29709c67dfa470a6b62c3461b9fa2b421720fa01cefb3ac69074be: Status 404 returned error can't find the container with id ea6c165ade29709c67dfa470a6b62c3461b9fa2b421720fa01cefb3ac69074be
Jul 14 16:37:34.031681 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.031544    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb" event={"ID":"252aab24-45df-456e-8218-0cdabfc492d9","Type":"ContainerStarted","Data":"ac8e397fd081fb58f304ca7e9e6b7f8a524e7663a033fea430b19bcc7d6277ac"}
Jul 14 16:37:34.031681 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.031610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb" event={"ID":"252aab24-45df-456e-8218-0cdabfc492d9","Type":"ContainerStarted","Data":"7b80fd41f30bf1f6668b8636a3b1942812fe32baa5d4a16325b0312953b0b20a"}
Jul 14 16:37:34.032196 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.031716    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:34.035401 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.035019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn" event={"ID":"93eae44c-94b7-4162-8848-b8a2162e9785","Type":"ContainerStarted","Data":"82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28"}
Jul 14 16:37:34.035401 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.035073    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn" event={"ID":"93eae44c-94b7-4162-8848-b8a2162e9785","Type":"ContainerStarted","Data":"ea6c165ade29709c67dfa470a6b62c3461b9fa2b421720fa01cefb3ac69074be"}
Jul 14 16:37:34.035401 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.035102    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:34.036914 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.036891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m" event={"ID":"3db43a8e-19d4-4897-af3c-eff9e29b454a","Type":"ContainerStarted","Data":"fab2da60166f33a0114f7ebd14fe126a1c7a940eb23f9015f5f01e37005d9c4a"}
Jul 14 16:37:34.037058 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.036933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m" event={"ID":"3db43a8e-19d4-4897-af3c-eff9e29b454a","Type":"ContainerStarted","Data":"2d076b0c7a829da30012aa1bb239ab697ba868e6bb06b160b4a81212b2111c6a"}
Jul 14 16:37:34.037058 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.036964    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"
Jul 14 16:37:34.038276 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.038252    2576 generic.go:356] "Generic (PLEG): container finished" podID="b12627e3-54b2-4540-9575-32a34752e0a0" containerID="af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4" exitCode=0
Jul 14 16:37:34.038390 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.038321    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:34.038390 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.038356    2576 scope.go:117] "RemoveContainer" containerID="af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4"
Jul 14 16:37:34.038485 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.038407    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:34.039996 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.039973    2576 generic.go:356] "Generic (PLEG): container finished" podID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" containerID="518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9" exitCode=0
Jul 14 16:37:34.040088 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.040028    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:34.040088 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.040040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:34.041078 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.041049    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:34.048347 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.048324    2576 scope.go:117] "RemoveContainer" containerID="af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4"
Jul 14 16:37:34.048599 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.048579    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4\": container with ID starting with af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4 not found: ID does not exist" containerID="af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4"
Jul 14 16:37:34.048697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.048607    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4"} err="failed to get container status \"af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4\": rpc error: code = NotFound desc = could not find container \"af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4\": container with ID starting with af480c54a509e8835e5612b9c7f88f96f4e2d15c8d0d6a0ec0b6f2c3fdcdeea4 not found: ID does not exist"
Jul 14 16:37:34.048697 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.048638    2576 scope.go:117] "RemoveContainer" containerID="518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9"
Jul 14 16:37:34.056970 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.056954    2576 scope.go:117] "RemoveContainer" containerID="518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9"
Jul 14 16:37:34.057232 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.057216    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9\": container with ID starting with 518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9 not found: ID does not exist" containerID="518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9"
Jul 14 16:37:34.057277 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.057240    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9"} err="failed to get container status \"518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9\": rpc error: code = NotFound desc = could not find container \"518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9\": container with ID starting with 518027f0d85141dc397aba89529932077518a9f82166688c04dd58407337dca9 not found: ID does not exist"
Jul 14 16:37:34.084957 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.084890    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:34.093987 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.093942    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb" podStartSLOduration=2.093921613 podStartE2EDuration="2.093921613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:34.082252177 +0000 UTC m=+443.212236376" watchObservedRunningTime="2026-07-14 16:37:34.093921613 +0000 UTC m=+443.223905813"
Jul 14 16:37:34.150579 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.150530    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn" podStartSLOduration=2.150514861 podStartE2EDuration="2.150514861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:34.149110238 +0000 UTC m=+443.279094438" watchObservedRunningTime="2026-07-14 16:37:34.150514861 +0000 UTC m=+443.280499061"
Jul 14 16:37:34.179185 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.179130    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m" podStartSLOduration=2.179113874 podStartE2EDuration="2.179113874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:34.177358054 +0000 UTC m=+443.307342255" watchObservedRunningTime="2026-07-14 16:37:34.179113874 +0000 UTC m=+443.309098073"
Jul 14 16:37:34.182528 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.182499    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-csnww\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-csnww"
Jul 14 16:37:34.184522 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.184497    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5fhwb\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5fhwb"
Jul 14 16:37:34.188548 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:34.188521    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-h7lfz\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h7lfz"
Jul 14 16:37:34.306457 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.306374    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12627e3-54b2-4540-9575-32a34752e0a0" path="/var/lib/kubelet/pods/b12627e3-54b2-4540-9575-32a34752e0a0/volumes"
Jul 14 16:37:34.306772 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.306758    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16ac76d-d812-43e9-948d-c3edb06412f5" path="/var/lib/kubelet/pods/b16ac76d-d812-43e9-948d-c3edb06412f5/volumes"
Jul 14 16:37:34.307011 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:34.307000    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc743318-f8e5-46c4-a2c4-7e97ea1e17db" path="/var/lib/kubelet/pods/fc743318-f8e5-46c4-a2c4-7e97ea1e17db/volumes"
Jul 14 16:37:45.048470 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.048426    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s457m"
Jul 14 16:37:45.048930 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.048509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:45.048930 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.048541    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:37:45.144306 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.144272    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"]
Jul 14 16:37:45.144470 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.144451    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn" podUID="93eae44c-94b7-4162-8848-b8a2162e9785" containerName="manager" containerID="cri-o://82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28" gracePeriod=10
Jul 14 16:37:45.391071 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.391049    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:45.456522 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.456498    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93eae44c-94b7-4162-8848-b8a2162e9785-extensions-socket-volume\") pod \"93eae44c-94b7-4162-8848-b8a2162e9785\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") "
Jul 14 16:37:45.456682 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.456533    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldv2w\" (UniqueName: \"kubernetes.io/projected/93eae44c-94b7-4162-8848-b8a2162e9785-kube-api-access-ldv2w\") pod \"93eae44c-94b7-4162-8848-b8a2162e9785\" (UID: \"93eae44c-94b7-4162-8848-b8a2162e9785\") "
Jul 14 16:37:45.456907 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.456883    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93eae44c-94b7-4162-8848-b8a2162e9785-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "93eae44c-94b7-4162-8848-b8a2162e9785" (UID: "93eae44c-94b7-4162-8848-b8a2162e9785"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:45.458577 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.458550    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93eae44c-94b7-4162-8848-b8a2162e9785-kube-api-access-ldv2w" (OuterVolumeSpecName: "kube-api-access-ldv2w") pod "93eae44c-94b7-4162-8848-b8a2162e9785" (UID: "93eae44c-94b7-4162-8848-b8a2162e9785"). InnerVolumeSpecName "kube-api-access-ldv2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:37:45.558117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.558089    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93eae44c-94b7-4162-8848-b8a2162e9785-extensions-socket-volume\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:37:45.558117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:45.558112    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldv2w\" (UniqueName: \"kubernetes.io/projected/93eae44c-94b7-4162-8848-b8a2162e9785-kube-api-access-ldv2w\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:37:46.102734 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.102697    2576 generic.go:356] "Generic (PLEG): container finished" podID="93eae44c-94b7-4162-8848-b8a2162e9785" containerID="82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28" exitCode=0
Jul 14 16:37:46.103143 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.102738    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"
Jul 14 16:37:46.103143 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.102770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn" event={"ID":"93eae44c-94b7-4162-8848-b8a2162e9785","Type":"ContainerDied","Data":"82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28"}
Jul 14 16:37:46.103143 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.102821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn" event={"ID":"93eae44c-94b7-4162-8848-b8a2162e9785","Type":"ContainerDied","Data":"ea6c165ade29709c67dfa470a6b62c3461b9fa2b421720fa01cefb3ac69074be"}
Jul 14 16:37:46.103143 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.102846    2576 scope.go:117] "RemoveContainer" containerID="82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28"
Jul 14 16:37:46.116237 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.116204    2576 scope.go:117] "RemoveContainer" containerID="82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28"
Jul 14 16:37:46.116612 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:37:46.116575    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28\": container with ID starting with 82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28 not found: ID does not exist" containerID="82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28"
Jul 14 16:37:46.116748 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.116618    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28"} err="failed to get container status \"82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28\": rpc error: code = NotFound desc = could not find container \"82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28\": container with ID starting with 82adfedab768d15aa1bb77177eeb8f251e435f4f7344ca97074fbb41a8651f28 not found: ID does not exist"
Jul 14 16:37:46.143426 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.143377    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"]
Jul 14 16:37:46.146576 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.146551    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fr9qn"]
Jul 14 16:37:46.307048 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:37:46.307014    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93eae44c-94b7-4162-8848-b8a2162e9785" path="/var/lib/kubelet/pods/93eae44c-94b7-4162-8848-b8a2162e9785/volumes"
Jul 14 16:38:03.841475 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.841438    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"]
Jul 14 16:38:03.841888 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.841809    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93eae44c-94b7-4162-8848-b8a2162e9785" containerName="manager"
Jul 14 16:38:03.841888 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.841820    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93eae44c-94b7-4162-8848-b8a2162e9785" containerName="manager"
Jul 14 16:38:03.841888 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.841886    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93eae44c-94b7-4162-8848-b8a2162e9785" containerName="manager"
Jul 14 16:38:03.846666 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.846643    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:03.849577 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.849549    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 16:38:03.849712 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.849648    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8xkxt\""
Jul 14 16:38:03.859878 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.859851    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"]
Jul 14 16:38:03.910769 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.910738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99jv4\" (UniqueName: \"kubernetes.io/projected/04e49a25-25e9-4642-98df-28be7d0524f2-kube-api-access-99jv4\") pod \"limitador-limitador-64c94fd64f-lx5ds\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:03.910929 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.910785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04e49a25-25e9-4642-98df-28be7d0524f2-config-file\") pod \"limitador-limitador-64c94fd64f-lx5ds\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:03.942209 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:03.942174    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"]
Jul 14 16:38:04.011920 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:04.011881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99jv4\" (UniqueName: \"kubernetes.io/projected/04e49a25-25e9-4642-98df-28be7d0524f2-kube-api-access-99jv4\") pod \"limitador-limitador-64c94fd64f-lx5ds\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:04.012084 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:04.011937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04e49a25-25e9-4642-98df-28be7d0524f2-config-file\") pod \"limitador-limitador-64c94fd64f-lx5ds\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:04.012597 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:04.012578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04e49a25-25e9-4642-98df-28be7d0524f2-config-file\") pod \"limitador-limitador-64c94fd64f-lx5ds\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:04.026302 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:04.026268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99jv4\" (UniqueName: \"kubernetes.io/projected/04e49a25-25e9-4642-98df-28be7d0524f2-kube-api-access-99jv4\") pod \"limitador-limitador-64c94fd64f-lx5ds\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:04.156855 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:04.156769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:04.294855 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:04.294832    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"]
Jul 14 16:38:05.187857 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:05.187818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds" event={"ID":"04e49a25-25e9-4642-98df-28be7d0524f2","Type":"ContainerStarted","Data":"76157d6c0d412291251cf3201f62b85d173c178ce30a3c0000bc6824857a2dfc"}
Jul 14 16:38:08.202845 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:08.202811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds" event={"ID":"04e49a25-25e9-4642-98df-28be7d0524f2","Type":"ContainerStarted","Data":"3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52"}
Jul 14 16:38:08.203211 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:08.202943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:08.222492 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:08.222444    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds" podStartSLOduration=1.889979852 podStartE2EDuration="5.222430525s" totalImagesPullingTime="3.332450673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:08.222081535 +0000 UTC m=+477.352065736" watchObservedRunningTime="2026-07-14 16:38:08.222430525 +0000 UTC m=+477.352414725"
Jul 14 16:38:19.169454 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.169415    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"]
Jul 14 16:38:19.170050 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.169670    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds" podUID="04e49a25-25e9-4642-98df-28be7d0524f2" containerName="limitador" containerID="cri-o://3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52" gracePeriod=30
Jul 14 16:38:19.170520 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.170429    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:19.717393 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.717366    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:19.753567 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.753534    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04e49a25-25e9-4642-98df-28be7d0524f2-config-file\") pod \"04e49a25-25e9-4642-98df-28be7d0524f2\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") "
Jul 14 16:38:19.753701 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.753587    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99jv4\" (UniqueName: \"kubernetes.io/projected/04e49a25-25e9-4642-98df-28be7d0524f2-kube-api-access-99jv4\") pod \"04e49a25-25e9-4642-98df-28be7d0524f2\" (UID: \"04e49a25-25e9-4642-98df-28be7d0524f2\") "
Jul 14 16:38:19.753882 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.753859    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e49a25-25e9-4642-98df-28be7d0524f2-config-file" (OuterVolumeSpecName: "config-file") pod "04e49a25-25e9-4642-98df-28be7d0524f2" (UID: "04e49a25-25e9-4642-98df-28be7d0524f2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:38:19.755528 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.755505    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e49a25-25e9-4642-98df-28be7d0524f2-kube-api-access-99jv4" (OuterVolumeSpecName: "kube-api-access-99jv4") pod "04e49a25-25e9-4642-98df-28be7d0524f2" (UID: "04e49a25-25e9-4642-98df-28be7d0524f2"). InnerVolumeSpecName "kube-api-access-99jv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:38:19.854582 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.854557    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04e49a25-25e9-4642-98df-28be7d0524f2-config-file\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:38:19.854582 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:19.854582    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99jv4\" (UniqueName: \"kubernetes.io/projected/04e49a25-25e9-4642-98df-28be7d0524f2-kube-api-access-99jv4\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:38:20.258256 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.258217    2576 generic.go:356] "Generic (PLEG): container finished" podID="04e49a25-25e9-4642-98df-28be7d0524f2" containerID="3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52" exitCode=0
Jul 14 16:38:20.258735 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.258281    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"
Jul 14 16:38:20.258735 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.258311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds" event={"ID":"04e49a25-25e9-4642-98df-28be7d0524f2","Type":"ContainerDied","Data":"3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52"}
Jul 14 16:38:20.258735 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.258420    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx5ds" event={"ID":"04e49a25-25e9-4642-98df-28be7d0524f2","Type":"ContainerDied","Data":"76157d6c0d412291251cf3201f62b85d173c178ce30a3c0000bc6824857a2dfc"}
Jul 14 16:38:20.258735 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.258455    2576 scope.go:117] "RemoveContainer" containerID="3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52"
Jul 14 16:38:20.267034 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.267017    2576 scope.go:117] "RemoveContainer" containerID="3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52"
Jul 14 16:38:20.267347 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:38:20.267297    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52\": container with ID starting with 3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52 not found: ID does not exist" containerID="3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52"
Jul 14 16:38:20.267347 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.267322    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52"} err="failed to get container status \"3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52\": rpc error: code = NotFound desc = could not find container \"3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52\": container with ID starting with 3e6f281503a11dcfe72e7440dd3d12b7572a1796b9221744118fcf3192650f52 not found: ID does not exist"
Jul 14 16:38:20.282907 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.282886    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"]
Jul 14 16:38:20.289933 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.289912    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx5ds"]
Jul 14 16:38:20.306956 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:20.306929    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04e49a25-25e9-4642-98df-28be7d0524f2" path="/var/lib/kubelet/pods/04e49a25-25e9-4642-98df-28be7d0524f2/volumes"
Jul 14 16:38:25.396800 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.396767    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-jh52x"]
Jul 14 16:38:25.397261 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.397144    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e49a25-25e9-4642-98df-28be7d0524f2" containerName="limitador"
Jul 14 16:38:25.397261 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.397157    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e49a25-25e9-4642-98df-28be7d0524f2" containerName="limitador"
Jul 14 16:38:25.397261 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.397225    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e49a25-25e9-4642-98df-28be7d0524f2" containerName="limitador"
Jul 14 16:38:25.401505 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.401483    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.404366 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.404344    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qmzdb\""
Jul 14 16:38:25.404515 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.404344    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 14 16:38:25.409029 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.409001    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jh52x"]
Jul 14 16:38:25.504921 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.504883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b03a6cfc-f29b-4fed-91e3-2f33c0d26416-data\") pod \"postgres-69fb4594cf-jh52x\" (UID: \"b03a6cfc-f29b-4fed-91e3-2f33c0d26416\") " pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.505086 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.504928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tf7s\" (UniqueName: \"kubernetes.io/projected/b03a6cfc-f29b-4fed-91e3-2f33c0d26416-kube-api-access-5tf7s\") pod \"postgres-69fb4594cf-jh52x\" (UID: \"b03a6cfc-f29b-4fed-91e3-2f33c0d26416\") " pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.605586 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.605554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b03a6cfc-f29b-4fed-91e3-2f33c0d26416-data\") pod \"postgres-69fb4594cf-jh52x\" (UID: \"b03a6cfc-f29b-4fed-91e3-2f33c0d26416\") " pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.605756 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.605594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tf7s\" (UniqueName: \"kubernetes.io/projected/b03a6cfc-f29b-4fed-91e3-2f33c0d26416-kube-api-access-5tf7s\") pod \"postgres-69fb4594cf-jh52x\" (UID: \"b03a6cfc-f29b-4fed-91e3-2f33c0d26416\") " pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.606003 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.605983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b03a6cfc-f29b-4fed-91e3-2f33c0d26416-data\") pod \"postgres-69fb4594cf-jh52x\" (UID: \"b03a6cfc-f29b-4fed-91e3-2f33c0d26416\") " pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.615427 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.615398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tf7s\" (UniqueName: \"kubernetes.io/projected/b03a6cfc-f29b-4fed-91e3-2f33c0d26416-kube-api-access-5tf7s\") pod \"postgres-69fb4594cf-jh52x\" (UID: \"b03a6cfc-f29b-4fed-91e3-2f33c0d26416\") " pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.713559 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.713478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:25.837732 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:25.837699    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jh52x"]
Jul 14 16:38:25.839937 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:38:25.839906    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03a6cfc_f29b_4fed_91e3_2f33c0d26416.slice/crio-346100de92e68b2795aebae941d2200489b41664e45b7bc6990dcc733629cd9d WatchSource:0}: Error finding container 346100de92e68b2795aebae941d2200489b41664e45b7bc6990dcc733629cd9d: Status 404 returned error can't find the container with id 346100de92e68b2795aebae941d2200489b41664e45b7bc6990dcc733629cd9d
Jul 14 16:38:26.286109 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:26.286077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jh52x" event={"ID":"b03a6cfc-f29b-4fed-91e3-2f33c0d26416","Type":"ContainerStarted","Data":"346100de92e68b2795aebae941d2200489b41664e45b7bc6990dcc733629cd9d"}
Jul 14 16:38:31.314727 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:31.314692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jh52x" event={"ID":"b03a6cfc-f29b-4fed-91e3-2f33c0d26416","Type":"ContainerStarted","Data":"e2c0c04b4b25fe17b69e8ac2c6b4b88c65e3864a769400ce5736b0e67ecc2675"}
Jul 14 16:38:31.315118 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:31.314815    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:31.336931 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:31.336865    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-jh52x" podStartSLOduration=1.340401932 podStartE2EDuration="6.336841567s" totalImagesPullingTime="4.996439635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:31.333935388 +0000 UTC m=+500.463919589" watchObservedRunningTime="2026-07-14 16:38:31.336841567 +0000 UTC m=+500.466825769"
Jul 14 16:38:37.348778 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:37.348749    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-jh52x"
Jul 14 16:38:44.559279 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.559244    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-646567455-pdc4m"]
Jul 14 16:38:44.743640 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.743588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-646567455-pdc4m"]
Jul 14 16:38:44.743793 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.743703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:44.746819 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.746794    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 16:38:44.747903 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.747881    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kgmpc\""
Jul 14 16:38:44.748023 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.747884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 16:38:44.748751 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.748728    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68c8c8b776-krtv9"]
Jul 14 16:38:44.769838 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.769813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68c8c8b776-krtv9"]
Jul 14 16:38:44.769958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.769897    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:44.870147 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.870078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvvxf\" (UniqueName: \"kubernetes.io/projected/68f7face-9cde-40dd-936b-17af5c6a68e3-kube-api-access-lvvxf\") pod \"maas-controller-68c8c8b776-krtv9\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") " pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:44.870147 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.870115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87wsr\" (UniqueName: \"kubernetes.io/projected/391dacbb-99e2-4371-b956-ecfb2c78c284-kube-api-access-87wsr\") pod \"maas-controller-646567455-pdc4m\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") " pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:44.870319 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.870156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68f7face-9cde-40dd-936b-17af5c6a68e3-webhook-cert\") pod \"maas-controller-68c8c8b776-krtv9\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") " pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:44.870319 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.870199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/391dacbb-99e2-4371-b956-ecfb2c78c284-webhook-cert\") pod \"maas-controller-646567455-pdc4m\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") " pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:44.971002 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.970969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvvxf\" (UniqueName: \"kubernetes.io/projected/68f7face-9cde-40dd-936b-17af5c6a68e3-kube-api-access-lvvxf\") pod \"maas-controller-68c8c8b776-krtv9\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") " pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:44.971174 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.971010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87wsr\" (UniqueName: \"kubernetes.io/projected/391dacbb-99e2-4371-b956-ecfb2c78c284-kube-api-access-87wsr\") pod \"maas-controller-646567455-pdc4m\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") " pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:44.971174 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.971130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68f7face-9cde-40dd-936b-17af5c6a68e3-webhook-cert\") pod \"maas-controller-68c8c8b776-krtv9\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") " pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:44.971249 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.971218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/391dacbb-99e2-4371-b956-ecfb2c78c284-webhook-cert\") pod \"maas-controller-646567455-pdc4m\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") " pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:44.973669 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.973619    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68f7face-9cde-40dd-936b-17af5c6a68e3-webhook-cert\") pod \"maas-controller-68c8c8b776-krtv9\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") " pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:44.973788 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.973738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/391dacbb-99e2-4371-b956-ecfb2c78c284-webhook-cert\") pod \"maas-controller-646567455-pdc4m\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") " pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:44.980604 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.980582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvvxf\" (UniqueName: \"kubernetes.io/projected/68f7face-9cde-40dd-936b-17af5c6a68e3-kube-api-access-lvvxf\") pod \"maas-controller-68c8c8b776-krtv9\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") " pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:44.980772 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:44.980700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87wsr\" (UniqueName: \"kubernetes.io/projected/391dacbb-99e2-4371-b956-ecfb2c78c284-kube-api-access-87wsr\") pod \"maas-controller-646567455-pdc4m\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") " pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:45.054402 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:45.054377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:45.079125 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:45.079099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:45.203302 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:45.203277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-646567455-pdc4m"]
Jul 14 16:38:45.206438 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:38:45.206414    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391dacbb_99e2_4371_b956_ecfb2c78c284.slice/crio-8cca6d3a95dd196656f389f1d822e63f628c6c4a4c9a7c57cf588642f6518109 WatchSource:0}: Error finding container 8cca6d3a95dd196656f389f1d822e63f628c6c4a4c9a7c57cf588642f6518109: Status 404 returned error can't find the container with id 8cca6d3a95dd196656f389f1d822e63f628c6c4a4c9a7c57cf588642f6518109
Jul 14 16:38:45.226005 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:45.225984    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68c8c8b776-krtv9"]
Jul 14 16:38:45.227988 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:38:45.227970    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f7face_9cde_40dd_936b_17af5c6a68e3.slice/crio-5d599e47f9881ac70c3f91c7dc63d9c9f9634af77e20a4ea5b274b376c864d4a WatchSource:0}: Error finding container 5d599e47f9881ac70c3f91c7dc63d9c9f9634af77e20a4ea5b274b376c864d4a: Status 404 returned error can't find the container with id 5d599e47f9881ac70c3f91c7dc63d9c9f9634af77e20a4ea5b274b376c864d4a
Jul 14 16:38:45.376791 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:45.376753    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-646567455-pdc4m" event={"ID":"391dacbb-99e2-4371-b956-ecfb2c78c284","Type":"ContainerStarted","Data":"8cca6d3a95dd196656f389f1d822e63f628c6c4a4c9a7c57cf588642f6518109"}
Jul 14 16:38:45.377833 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:45.377811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68c8c8b776-krtv9" event={"ID":"68f7face-9cde-40dd-936b-17af5c6a68e3","Type":"ContainerStarted","Data":"5d599e47f9881ac70c3f91c7dc63d9c9f9634af77e20a4ea5b274b376c864d4a"}
Jul 14 16:38:48.398615 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:48.398573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-646567455-pdc4m" event={"ID":"391dacbb-99e2-4371-b956-ecfb2c78c284","Type":"ContainerStarted","Data":"c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902"}
Jul 14 16:38:48.399103 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:48.398774    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:48.400296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:48.400266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68c8c8b776-krtv9" event={"ID":"68f7face-9cde-40dd-936b-17af5c6a68e3","Type":"ContainerStarted","Data":"3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791"}
Jul 14 16:38:48.400406 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:48.400312    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:48.419156 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:48.419110    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-646567455-pdc4m" podStartSLOduration=1.6787529239999999 podStartE2EDuration="4.419093877s" totalImagesPullingTime="2.740340953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:48.416956307 +0000 UTC m=+517.546940547" watchObservedRunningTime="2026-07-14 16:38:48.419093877 +0000 UTC m=+517.549078110"
Jul 14 16:38:59.411233 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.411198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:59.411683 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.411278    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:38:59.449438 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.449382    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68c8c8b776-krtv9" podStartSLOduration=12.722423065 podStartE2EDuration="15.449365391s" totalImagesPullingTime="2.726942326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:48.436343181 +0000 UTC m=+517.566327383" watchObservedRunningTime="2026-07-14 16:38:59.449365391 +0000 UTC m=+528.579349631"
Jul 14 16:38:59.522597 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.522570    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-646567455-pdc4m"]
Jul 14 16:38:59.522830 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.522775    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-646567455-pdc4m" podUID="391dacbb-99e2-4371-b956-ecfb2c78c284" containerName="manager" containerID="cri-o://c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902" gracePeriod=30
Jul 14 16:38:59.767101 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.767077    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:38:59.904933 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.904905    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87wsr\" (UniqueName: \"kubernetes.io/projected/391dacbb-99e2-4371-b956-ecfb2c78c284-kube-api-access-87wsr\") pod \"391dacbb-99e2-4371-b956-ecfb2c78c284\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") "
Jul 14 16:38:59.905109 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.904943    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/391dacbb-99e2-4371-b956-ecfb2c78c284-webhook-cert\") pod \"391dacbb-99e2-4371-b956-ecfb2c78c284\" (UID: \"391dacbb-99e2-4371-b956-ecfb2c78c284\") "
Jul 14 16:38:59.906975 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.906943    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391dacbb-99e2-4371-b956-ecfb2c78c284-kube-api-access-87wsr" (OuterVolumeSpecName: "kube-api-access-87wsr") pod "391dacbb-99e2-4371-b956-ecfb2c78c284" (UID: "391dacbb-99e2-4371-b956-ecfb2c78c284"). InnerVolumeSpecName "kube-api-access-87wsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:38:59.907074 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:38:59.907012    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/391dacbb-99e2-4371-b956-ecfb2c78c284-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "391dacbb-99e2-4371-b956-ecfb2c78c284" (UID: "391dacbb-99e2-4371-b956-ecfb2c78c284"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:39:00.006135 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.006106    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87wsr\" (UniqueName: \"kubernetes.io/projected/391dacbb-99e2-4371-b956-ecfb2c78c284-kube-api-access-87wsr\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:39:00.006135 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.006133    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/391dacbb-99e2-4371-b956-ecfb2c78c284-webhook-cert\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:39:00.462340 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.462305    2576 generic.go:356] "Generic (PLEG): container finished" podID="391dacbb-99e2-4371-b956-ecfb2c78c284" containerID="c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902" exitCode=0
Jul 14 16:39:00.462702 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.462350    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-646567455-pdc4m"
Jul 14 16:39:00.462702 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.462381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-646567455-pdc4m" event={"ID":"391dacbb-99e2-4371-b956-ecfb2c78c284","Type":"ContainerDied","Data":"c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902"}
Jul 14 16:39:00.462702 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.462436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-646567455-pdc4m" event={"ID":"391dacbb-99e2-4371-b956-ecfb2c78c284","Type":"ContainerDied","Data":"8cca6d3a95dd196656f389f1d822e63f628c6c4a4c9a7c57cf588642f6518109"}
Jul 14 16:39:00.462702 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.462459    2576 scope.go:117] "RemoveContainer" containerID="c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902"
Jul 14 16:39:00.470188 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.470168    2576 scope.go:117] "RemoveContainer" containerID="c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902"
Jul 14 16:39:00.470449 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:39:00.470431    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902\": container with ID starting with c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902 not found: ID does not exist" containerID="c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902"
Jul 14 16:39:00.470493 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.470458    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902"} err="failed to get container status \"c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902\": rpc error: code = NotFound desc = could not find container \"c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902\": container with ID starting with c5b08be1bcc08758ab72cad73ba2741125ae0f0a532b25f9522d364b2af00902 not found: ID does not exist"
Jul 14 16:39:00.490701 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.490681    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-646567455-pdc4m"]
Jul 14 16:39:00.494356 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:00.494330    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-646567455-pdc4m"]
Jul 14 16:39:02.307022 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:02.306983    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="391dacbb-99e2-4371-b956-ecfb2c78c284" path="/var/lib/kubelet/pods/391dacbb-99e2-4371-b956-ecfb2c78c284/volumes"
Jul 14 16:39:21.767054 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.767019    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-686f669d5d-vzwm5"]
Jul 14 16:39:21.767762 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.767355    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391dacbb-99e2-4371-b956-ecfb2c78c284" containerName="manager"
Jul 14 16:39:21.767762 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.767366    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="391dacbb-99e2-4371-b956-ecfb2c78c284" containerName="manager"
Jul 14 16:39:21.767762 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.767436    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="391dacbb-99e2-4371-b956-ecfb2c78c284" containerName="manager"
Jul 14 16:39:21.773706 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.773689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.776308 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.776288    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 14 16:39:21.776418 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.776330    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-drb76\""
Jul 14 16:39:21.781787 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.781453    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-686f669d5d-vzwm5"]
Jul 14 16:39:21.882744 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.882701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad16b8e-9d68-48b4-8565-66ac531b0d55-maas-api-tls\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.882912 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.882753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqpcs\" (UniqueName: \"kubernetes.io/projected/fad16b8e-9d68-48b4-8565-66ac531b0d55-kube-api-access-rqpcs\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.882912 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.882893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad16b8e-9d68-48b4-8565-66ac531b0d55-openshift-service-ca\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.984210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.984172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad16b8e-9d68-48b4-8565-66ac531b0d55-openshift-service-ca\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.984210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.984214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad16b8e-9d68-48b4-8565-66ac531b0d55-maas-api-tls\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.984415 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.984233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqpcs\" (UniqueName: \"kubernetes.io/projected/fad16b8e-9d68-48b4-8565-66ac531b0d55-kube-api-access-rqpcs\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.985070 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.985034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad16b8e-9d68-48b4-8565-66ac531b0d55-openshift-service-ca\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.986787 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.986767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad16b8e-9d68-48b4-8565-66ac531b0d55-maas-api-tls\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:21.993083 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:21.993063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqpcs\" (UniqueName: \"kubernetes.io/projected/fad16b8e-9d68-48b4-8565-66ac531b0d55-kube-api-access-rqpcs\") pod \"maas-api-686f669d5d-vzwm5\" (UID: \"fad16b8e-9d68-48b4-8565-66ac531b0d55\") " pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:22.085878 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.085800    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:22.223051 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.223027    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-686f669d5d-vzwm5"]
Jul 14 16:39:22.224958 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:39:22.224922    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad16b8e_9d68_48b4_8565_66ac531b0d55.slice/crio-ac37c9ba1ea3a03bcefb82da7bd43f461a1607ffe5d096da61d6882f83c8c5c2 WatchSource:0}: Error finding container ac37c9ba1ea3a03bcefb82da7bd43f461a1607ffe5d096da61d6882f83c8c5c2: Status 404 returned error can't find the container with id ac37c9ba1ea3a03bcefb82da7bd43f461a1607ffe5d096da61d6882f83c8c5c2
Jul 14 16:39:22.282177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.279659    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2s5d2"]
Jul 14 16:39:22.285742 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.285719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.288826 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.288805    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 16:39:22.296594 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.296564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2s5d2"]
Jul 14 16:39:22.310315 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.310287    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mgkmk"]
Jul 14 16:39:22.313499 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.313481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.316713 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.316692    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qvzh2\""
Jul 14 16:39:22.331903 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.331878    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mgkmk"]
Jul 14 16:39:22.387273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.387204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2s5d2\" (UID: \"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.387273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.387237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phwdp\" (UniqueName: \"kubernetes.io/projected/6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4-kube-api-access-phwdp\") pod \"payload-pre-processing-7964457696-2s5d2\" (UID: \"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.387273 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.387265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b5d6\" (UniqueName: \"kubernetes.io/projected/47aa168d-9295-4669-999c-a214a8d25d05-kube-api-access-7b5d6\") pod \"payload-processing-58f86c7798-mgkmk\" (UID: \"47aa168d-9295-4669-999c-a214a8d25d05\") " pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.387508 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.387317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa168d-9295-4669-999c-a214a8d25d05-plugins-config-volume\") pod \"payload-processing-58f86c7798-mgkmk\" (UID: \"47aa168d-9295-4669-999c-a214a8d25d05\") " pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.488168 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.488131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa168d-9295-4669-999c-a214a8d25d05-plugins-config-volume\") pod \"payload-processing-58f86c7798-mgkmk\" (UID: \"47aa168d-9295-4669-999c-a214a8d25d05\") " pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.488345 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.488241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2s5d2\" (UID: \"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.488345 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.488268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phwdp\" (UniqueName: \"kubernetes.io/projected/6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4-kube-api-access-phwdp\") pod \"payload-pre-processing-7964457696-2s5d2\" (UID: \"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.488345 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.488296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5d6\" (UniqueName: \"kubernetes.io/projected/47aa168d-9295-4669-999c-a214a8d25d05-kube-api-access-7b5d6\") pod \"payload-processing-58f86c7798-mgkmk\" (UID: \"47aa168d-9295-4669-999c-a214a8d25d05\") " pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.488889 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.488869    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa168d-9295-4669-999c-a214a8d25d05-plugins-config-volume\") pod \"payload-processing-58f86c7798-mgkmk\" (UID: \"47aa168d-9295-4669-999c-a214a8d25d05\") " pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.488967 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.488945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2s5d2\" (UID: \"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.497505 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.497485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5d6\" (UniqueName: \"kubernetes.io/projected/47aa168d-9295-4669-999c-a214a8d25d05-kube-api-access-7b5d6\") pod \"payload-processing-58f86c7798-mgkmk\" (UID: \"47aa168d-9295-4669-999c-a214a8d25d05\") " pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.497607 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.497590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phwdp\" (UniqueName: \"kubernetes.io/projected/6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4-kube-api-access-phwdp\") pod \"payload-pre-processing-7964457696-2s5d2\" (UID: \"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.560917 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.560883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-686f669d5d-vzwm5" event={"ID":"fad16b8e-9d68-48b4-8565-66ac531b0d55","Type":"ContainerStarted","Data":"ac37c9ba1ea3a03bcefb82da7bd43f461a1607ffe5d096da61d6882f83c8c5c2"}
Jul 14 16:39:22.601614 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.601583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:22.624729 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.624705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:22.752571 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.752545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2s5d2"]
Jul 14 16:39:22.755086 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:39:22.755061    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cce9c79_7ac9_4f9f_b6ad_3f8bf66309f4.slice/crio-b00304a28c6fcc315ed40fd4e9ca173758bac545a8c506d1803fcdff9c5aae2f WatchSource:0}: Error finding container b00304a28c6fcc315ed40fd4e9ca173758bac545a8c506d1803fcdff9c5aae2f: Status 404 returned error can't find the container with id b00304a28c6fcc315ed40fd4e9ca173758bac545a8c506d1803fcdff9c5aae2f
Jul 14 16:39:22.789713 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:22.789557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mgkmk"]
Jul 14 16:39:22.791685 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:39:22.791656    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47aa168d_9295_4669_999c_a214a8d25d05.slice/crio-0e16c70a2a31d24ecc13c51f8ad9d4e0b3337074af09c7800bb627d29858d73c WatchSource:0}: Error finding container 0e16c70a2a31d24ecc13c51f8ad9d4e0b3337074af09c7800bb627d29858d73c: Status 404 returned error can't find the container with id 0e16c70a2a31d24ecc13c51f8ad9d4e0b3337074af09c7800bb627d29858d73c
Jul 14 16:39:23.568403 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:23.568364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mgkmk" event={"ID":"47aa168d-9295-4669-999c-a214a8d25d05","Type":"ContainerStarted","Data":"0e16c70a2a31d24ecc13c51f8ad9d4e0b3337074af09c7800bb627d29858d73c"}
Jul 14 16:39:23.569690 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:23.569663    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2" event={"ID":"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4","Type":"ContainerStarted","Data":"b00304a28c6fcc315ed40fd4e9ca173758bac545a8c506d1803fcdff9c5aae2f"}
Jul 14 16:39:24.575874 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.575838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mgkmk" event={"ID":"47aa168d-9295-4669-999c-a214a8d25d05","Type":"ContainerStarted","Data":"428829b35d10ef727370457415afde1378995129f8e31fb5ba9f415b58f827cc"}
Jul 14 16:39:24.576339 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.575912    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:24.577295 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.577274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-686f669d5d-vzwm5" event={"ID":"fad16b8e-9d68-48b4-8565-66ac531b0d55","Type":"ContainerStarted","Data":"ff660f31a1bbf5df20677c550447568d24e3bde157a877df33e48507580d6ee6"}
Jul 14 16:39:24.577398 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.577328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:24.578656 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.578611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2" event={"ID":"6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4","Type":"ContainerStarted","Data":"d753c9a54bfc08ff3b07846273162731b0efb274ff9efd692417923ef3510ea3"}
Jul 14 16:39:24.578733 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.578676    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:24.594608 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.594565    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-mgkmk" podStartSLOduration=1.179786091 podStartE2EDuration="2.594552312s" totalImagesPullingTime="1.414766221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:39:24.59344513 +0000 UTC m=+553.723429330" watchObservedRunningTime="2026-07-14 16:39:24.594552312 +0000 UTC m=+553.724536512"
Jul 14 16:39:24.611510 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.611475    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-686f669d5d-vzwm5" podStartSLOduration=1.989578334 podStartE2EDuration="3.611462958s" totalImagesPullingTime="1.621884624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:39:24.611179178 +0000 UTC m=+553.741163403" watchObservedRunningTime="2026-07-14 16:39:24.611462958 +0000 UTC m=+553.741447157"
Jul 14 16:39:24.629654 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:24.629585    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2" podStartSLOduration=1.155620525 podStartE2EDuration="2.629573131s" totalImagesPullingTime="1.473952606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:39:24.627857419 +0000 UTC m=+553.757841620" watchObservedRunningTime="2026-07-14 16:39:24.629573131 +0000 UTC m=+553.759557331"
Jul 14 16:39:30.588689 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:30.588659    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-686f669d5d-vzwm5"
Jul 14 16:39:35.584399 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:35.584357    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-mgkmk"
Jul 14 16:39:35.584826 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:35.584773    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-2s5d2"
Jul 14 16:39:37.594542 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.594513    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"]
Jul 14 16:39:37.598133 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.598110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.601077 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.601045    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 16:39:37.601177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.601116    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 16:39:37.602236 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.602216    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 16:39:37.602342 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.602325    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6g4q6\""
Jul 14 16:39:37.617001 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.616978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"]
Jul 14 16:39:37.728765 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.728736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f09300ef-fea5-4a91-8dbd-07a027f871c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.728940 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.728793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.728940 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.728818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.728940 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.728859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.728940 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.728885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.728940 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.728907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgnk9\" (UniqueName: \"kubernetes.io/projected/f09300ef-fea5-4a91-8dbd-07a027f871c8-kube-api-access-wgnk9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.829495 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.829495 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.829750 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.829750 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.829750 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnk9\" (UniqueName: \"kubernetes.io/projected/f09300ef-fea5-4a91-8dbd-07a027f871c8-kube-api-access-wgnk9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.829914 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f09300ef-fea5-4a91-8dbd-07a027f871c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.829969 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.830024 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.829999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.830153 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.830114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.833313 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.833161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f09300ef-fea5-4a91-8dbd-07a027f871c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.833313 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.833248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f09300ef-fea5-4a91-8dbd-07a027f871c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.843617 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.843588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgnk9\" (UniqueName: \"kubernetes.io/projected/f09300ef-fea5-4a91-8dbd-07a027f871c8-kube-api-access-wgnk9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw\" (UID: \"f09300ef-fea5-4a91-8dbd-07a027f871c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:37.908222 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:37.908130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:38.046420 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:38.046392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"]
Jul 14 16:39:38.048260 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:39:38.048231    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09300ef_fea5_4a91_8dbd_07a027f871c8.slice/crio-44a32c506fc9277d3ffa42b1dc827a15e2cca95f6fc4970aa8d890e226a9a4b9 WatchSource:0}: Error finding container 44a32c506fc9277d3ffa42b1dc827a15e2cca95f6fc4970aa8d890e226a9a4b9: Status 404 returned error can't find the container with id 44a32c506fc9277d3ffa42b1dc827a15e2cca95f6fc4970aa8d890e226a9a4b9
Jul 14 16:39:38.648204 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:38.648158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw" event={"ID":"f09300ef-fea5-4a91-8dbd-07a027f871c8","Type":"ContainerStarted","Data":"44a32c506fc9277d3ffa42b1dc827a15e2cca95f6fc4970aa8d890e226a9a4b9"}
Jul 14 16:39:39.653869 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:39.653835    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw" event={"ID":"f09300ef-fea5-4a91-8dbd-07a027f871c8","Type":"ContainerStarted","Data":"80be8fcdb363c2119562043df0420cf302600ad9c1f6334d71a93a2d82eda603"}
Jul 14 16:39:39.686792 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:39.686697    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw" podStartSLOduration=1.638120245 podStartE2EDuration="2.686682653s" totalImagesPullingTime="1.048562408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:39:39.685600904 +0000 UTC m=+568.815585114" watchObservedRunningTime="2026-07-14 16:39:39.686682653 +0000 UTC m=+568.816666854"
Jul 14 16:39:47.908391 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:47.908360    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:47.908789 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:47.908420    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:47.920849 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:47.920823    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:48.705638 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:48.705608    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw"
Jul 14 16:39:51.587002 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.586966    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"]
Jul 14 16:39:51.590644 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.590608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.594014 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.593992    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 14 16:39:51.604230 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.604208    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"]
Jul 14 16:39:51.759662 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.759605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s49np\" (UniqueName: \"kubernetes.io/projected/4f34f880-d238-4e89-b688-af81e149129c-kube-api-access-s49np\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.759829 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.759705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.759829 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.759727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.759829 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.759744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.759829 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.759777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.759829 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.759798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f34f880-d238-4e89-b688-af81e149129c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861036 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.860955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f34f880-d238-4e89-b688-af81e149129c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861189 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49np\" (UniqueName: \"kubernetes.io/projected/4f34f880-d238-4e89-b688-af81e149129c-kube-api-access-s49np\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861189 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861189 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861189 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861189 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861549 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861615 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.861680 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.861616    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.863332 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.863316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f34f880-d238-4e89-b688-af81e149129c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.863413 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.863396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f34f880-d238-4e89-b688-af81e149129c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.872049 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.872026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s49np\" (UniqueName: \"kubernetes.io/projected/4f34f880-d238-4e89-b688-af81e149129c-kube-api-access-s49np\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8wrvk\" (UID: \"4f34f880-d238-4e89-b688-af81e149129c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:51.901777 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:51.901754    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:39:52.035151 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:52.035128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"]
Jul 14 16:39:52.037946 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:39:52.037915    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f34f880_d238_4e89_b688_af81e149129c.slice/crio-f53088294b0408acf210142d1766e21a72962da5e181a4a12c6c7c931ca66286 WatchSource:0}: Error finding container f53088294b0408acf210142d1766e21a72962da5e181a4a12c6c7c931ca66286: Status 404 returned error can't find the container with id f53088294b0408acf210142d1766e21a72962da5e181a4a12c6c7c931ca66286
Jul 14 16:39:52.715251 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:52.715163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk" event={"ID":"4f34f880-d238-4e89-b688-af81e149129c","Type":"ContainerStarted","Data":"05f2a2934d0e01b26ab6bfe6a953251ec2a28238f85a116b8eab88e3f0141e7c"}
Jul 14 16:39:52.715251 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:52.715224    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk" event={"ID":"4f34f880-d238-4e89-b688-af81e149129c","Type":"ContainerStarted","Data":"f53088294b0408acf210142d1766e21a72962da5e181a4a12c6c7c931ca66286"}
Jul 14 16:39:52.736993 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:39:52.736936    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk" podStartSLOduration=1.534435068 podStartE2EDuration="1.736913649s" totalImagesPullingTime="202.478581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:39:52.734039893 +0000 UTC m=+581.864024095" watchObservedRunningTime="2026-07-14 16:39:52.736913649 +0000 UTC m=+581.866897851"
Jul 14 16:40:01.902289 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:40:01.902241    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:40:01.902720 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:40:01.902345    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:40:01.915112 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:40:01.915090    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:40:02.773885 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:40:02.773856    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8wrvk"
Jul 14 16:42:44.452749 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.452715    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68c8c8b776-krtv9"]
Jul 14 16:42:44.453341 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.453050    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68c8c8b776-krtv9" podUID="68f7face-9cde-40dd-936b-17af5c6a68e3" containerName="manager" containerID="cri-o://3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791" gracePeriod=30
Jul 14 16:42:44.706441 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.706388    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:42:44.790057 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.790025    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68f7face-9cde-40dd-936b-17af5c6a68e3-webhook-cert\") pod \"68f7face-9cde-40dd-936b-17af5c6a68e3\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") "
Jul 14 16:42:44.790211 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.790118    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvvxf\" (UniqueName: \"kubernetes.io/projected/68f7face-9cde-40dd-936b-17af5c6a68e3-kube-api-access-lvvxf\") pod \"68f7face-9cde-40dd-936b-17af5c6a68e3\" (UID: \"68f7face-9cde-40dd-936b-17af5c6a68e3\") "
Jul 14 16:42:44.791948 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.791918    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f7face-9cde-40dd-936b-17af5c6a68e3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "68f7face-9cde-40dd-936b-17af5c6a68e3" (UID: "68f7face-9cde-40dd-936b-17af5c6a68e3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:42:44.792101 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.792079    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f7face-9cde-40dd-936b-17af5c6a68e3-kube-api-access-lvvxf" (OuterVolumeSpecName: "kube-api-access-lvvxf") pod "68f7face-9cde-40dd-936b-17af5c6a68e3" (UID: "68f7face-9cde-40dd-936b-17af5c6a68e3"). InnerVolumeSpecName "kube-api-access-lvvxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:42:44.891432 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.891390    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvvxf\" (UniqueName: \"kubernetes.io/projected/68f7face-9cde-40dd-936b-17af5c6a68e3-kube-api-access-lvvxf\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:42:44.891432 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:44.891431    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68f7face-9cde-40dd-936b-17af5c6a68e3-webhook-cert\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:42:45.514812 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.514780    2576 generic.go:356] "Generic (PLEG): container finished" podID="68f7face-9cde-40dd-936b-17af5c6a68e3" containerID="3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791" exitCode=0
Jul 14 16:42:45.515183 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.514819    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68c8c8b776-krtv9"
Jul 14 16:42:45.515183 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.514853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68c8c8b776-krtv9" event={"ID":"68f7face-9cde-40dd-936b-17af5c6a68e3","Type":"ContainerDied","Data":"3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791"}
Jul 14 16:42:45.515183 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.514908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68c8c8b776-krtv9" event={"ID":"68f7face-9cde-40dd-936b-17af5c6a68e3","Type":"ContainerDied","Data":"5d599e47f9881ac70c3f91c7dc63d9c9f9634af77e20a4ea5b274b376c864d4a"}
Jul 14 16:42:45.515183 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.514934    2576 scope.go:117] "RemoveContainer" containerID="3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791"
Jul 14 16:42:45.526258 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.526237    2576 scope.go:117] "RemoveContainer" containerID="3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791"
Jul 14 16:42:45.526533 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:42:45.526513    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791\": container with ID starting with 3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791 not found: ID does not exist" containerID="3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791"
Jul 14 16:42:45.526602 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.526545    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791"} err="failed to get container status \"3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791\": rpc error: code = NotFound desc = could not find container \"3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791\": container with ID starting with 3d15f7d9e69d69cf62b0b6740c1be59cefcc3e50f544fa575922cbc0bd1d2791 not found: ID does not exist"
Jul 14 16:42:45.540226 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.540199    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68c8c8b776-krtv9"]
Jul 14 16:42:45.544881 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:45.544857    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68c8c8b776-krtv9"]
Jul 14 16:42:46.307167 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.307128    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f7face-9cde-40dd-936b-17af5c6a68e3" path="/var/lib/kubelet/pods/68f7face-9cde-40dd-936b-17af5c6a68e3/volumes"
Jul 14 16:42:46.422395 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.422358    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68c8c8b776-w2kvf"]
Jul 14 16:42:46.422829 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.422811    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f7face-9cde-40dd-936b-17af5c6a68e3" containerName="manager"
Jul 14 16:42:46.422925 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.422831    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f7face-9cde-40dd-936b-17af5c6a68e3" containerName="manager"
Jul 14 16:42:46.422980 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.422931    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f7face-9cde-40dd-936b-17af5c6a68e3" containerName="manager"
Jul 14 16:42:46.427445 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.427424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.431413 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.431389    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 16:42:46.431521 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.431396    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 16:42:46.431521 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.431441    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kgmpc\""
Jul 14 16:42:46.437677 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.437656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68c8c8b776-w2kvf"]
Jul 14 16:42:46.503460 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.503431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/832f4dc4-c5f0-4d3c-959e-97818ad91985-webhook-cert\") pod \"maas-controller-68c8c8b776-w2kvf\" (UID: \"832f4dc4-c5f0-4d3c-959e-97818ad91985\") " pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.503460 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.503463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zqr\" (UniqueName: \"kubernetes.io/projected/832f4dc4-c5f0-4d3c-959e-97818ad91985-kube-api-access-76zqr\") pod \"maas-controller-68c8c8b776-w2kvf\" (UID: \"832f4dc4-c5f0-4d3c-959e-97818ad91985\") " pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.604887 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.604794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/832f4dc4-c5f0-4d3c-959e-97818ad91985-webhook-cert\") pod \"maas-controller-68c8c8b776-w2kvf\" (UID: \"832f4dc4-c5f0-4d3c-959e-97818ad91985\") " pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.604887 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.604830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zqr\" (UniqueName: \"kubernetes.io/projected/832f4dc4-c5f0-4d3c-959e-97818ad91985-kube-api-access-76zqr\") pod \"maas-controller-68c8c8b776-w2kvf\" (UID: \"832f4dc4-c5f0-4d3c-959e-97818ad91985\") " pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.607358 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.607331    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/832f4dc4-c5f0-4d3c-959e-97818ad91985-webhook-cert\") pod \"maas-controller-68c8c8b776-w2kvf\" (UID: \"832f4dc4-c5f0-4d3c-959e-97818ad91985\") " pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.615844 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.615822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zqr\" (UniqueName: \"kubernetes.io/projected/832f4dc4-c5f0-4d3c-959e-97818ad91985-kube-api-access-76zqr\") pod \"maas-controller-68c8c8b776-w2kvf\" (UID: \"832f4dc4-c5f0-4d3c-959e-97818ad91985\") " pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.738828 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.738791    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:46.868688 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.868665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68c8c8b776-w2kvf"]
Jul 14 16:42:46.870974 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:42:46.870945    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832f4dc4_c5f0_4d3c_959e_97818ad91985.slice/crio-1712def0683580264376ac6791b1ce19717e548d028668ca41cfba8d1cb5bfaf WatchSource:0}: Error finding container 1712def0683580264376ac6791b1ce19717e548d028668ca41cfba8d1cb5bfaf: Status 404 returned error can't find the container with id 1712def0683580264376ac6791b1ce19717e548d028668ca41cfba8d1cb5bfaf
Jul 14 16:42:46.872384 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:46.872367    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:42:47.527495 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:47.527467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68c8c8b776-w2kvf" event={"ID":"832f4dc4-c5f0-4d3c-959e-97818ad91985","Type":"ContainerStarted","Data":"d4af69be45e64b4b00943d42120b1808e2a67d7f39a63b79e644bc1b675bdf97"}
Jul 14 16:42:47.527680 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:47.527515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68c8c8b776-w2kvf" event={"ID":"832f4dc4-c5f0-4d3c-959e-97818ad91985","Type":"ContainerStarted","Data":"1712def0683580264376ac6791b1ce19717e548d028668ca41cfba8d1cb5bfaf"}
Jul 14 16:42:47.527680 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:47.527581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:42:47.548700 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:47.548647    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68c8c8b776-w2kvf" podStartSLOduration=1.057606501 podStartE2EDuration="1.548615249s" totalImagesPullingTime="491.008748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:42:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:42:47.546337906 +0000 UTC m=+756.676322107" watchObservedRunningTime="2026-07-14 16:42:47.548615249 +0000 UTC m=+756.678599499"
Jul 14 16:42:58.539296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:42:58.539267    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68c8c8b776-w2kvf"
Jul 14 16:45:00.176929 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.176895    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29734125-rttt5"]
Jul 14 16:45:00.180301 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.180285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5"
Jul 14 16:45:00.212242 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.212215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734125-rttt5"]
Jul 14 16:45:00.288583 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.288552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgcvk\" (UniqueName: \"kubernetes.io/projected/ea5041b6-18a5-4f15-a28c-c95996cb02ec-kube-api-access-vgcvk\") pod \"maas-api-key-cleanup-29734125-rttt5\" (UID: \"ea5041b6-18a5-4f15-a28c-c95996cb02ec\") " pod="opendatahub/maas-api-key-cleanup-29734125-rttt5"
Jul 14 16:45:00.389620 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.389591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgcvk\" (UniqueName: \"kubernetes.io/projected/ea5041b6-18a5-4f15-a28c-c95996cb02ec-kube-api-access-vgcvk\") pod \"maas-api-key-cleanup-29734125-rttt5\" (UID: \"ea5041b6-18a5-4f15-a28c-c95996cb02ec\") " pod="opendatahub/maas-api-key-cleanup-29734125-rttt5"
Jul 14 16:45:00.400831 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.400800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgcvk\" (UniqueName: \"kubernetes.io/projected/ea5041b6-18a5-4f15-a28c-c95996cb02ec-kube-api-access-vgcvk\") pod \"maas-api-key-cleanup-29734125-rttt5\" (UID: \"ea5041b6-18a5-4f15-a28c-c95996cb02ec\") " pod="opendatahub/maas-api-key-cleanup-29734125-rttt5"
Jul 14 16:45:00.509195 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.509160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5"
Jul 14 16:45:00.646817 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:00.646751    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734125-rttt5"]
Jul 14 16:45:00.649340 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:45:00.649310    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5041b6_18a5_4f15_a28c_c95996cb02ec.slice/crio-1cc8cabf26125ad8295bc62c093be17e658abc0be612be1e9fcd47ecb9bf4935 WatchSource:0}: Error finding container 1cc8cabf26125ad8295bc62c093be17e658abc0be612be1e9fcd47ecb9bf4935: Status 404 returned error can't find the container with id 1cc8cabf26125ad8295bc62c093be17e658abc0be612be1e9fcd47ecb9bf4935
Jul 14 16:45:01.165419 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:01.165379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5" event={"ID":"ea5041b6-18a5-4f15-a28c-c95996cb02ec","Type":"ContainerStarted","Data":"1cc8cabf26125ad8295bc62c093be17e658abc0be612be1e9fcd47ecb9bf4935"}
Jul 14 16:45:03.176292 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:03.176260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5" event={"ID":"ea5041b6-18a5-4f15-a28c-c95996cb02ec","Type":"ContainerStarted","Data":"9594f2db7a10eb2782d46f1a0c7fdce1dadc61b0d4028ae5a0086640e260797e"}
Jul 14 16:45:03.198605 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:03.198511    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5" podStartSLOduration=1.187225737 podStartE2EDuration="3.198494094s" totalImagesPullingTime="2.011268357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:45:03.197276131 +0000 UTC m=+892.327260331" watchObservedRunningTime="2026-07-14 16:45:03.198494094 +0000 UTC m=+892.328478294"
Jul 14 16:45:04.181743 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:04.181701    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea5041b6-18a5-4f15-a28c-c95996cb02ec" containerID="9594f2db7a10eb2782d46f1a0c7fdce1dadc61b0d4028ae5a0086640e260797e" exitCode=0
Jul 14 16:45:04.182118 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:04.181784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5" event={"ID":"ea5041b6-18a5-4f15-a28c-c95996cb02ec","Type":"ContainerDied","Data":"9594f2db7a10eb2782d46f1a0c7fdce1dadc61b0d4028ae5a0086640e260797e"}
Jul 14 16:45:05.321772 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:05.321743    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5"
Jul 14 16:45:05.435156 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:05.435117    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgcvk\" (UniqueName: \"kubernetes.io/projected/ea5041b6-18a5-4f15-a28c-c95996cb02ec-kube-api-access-vgcvk\") pod \"ea5041b6-18a5-4f15-a28c-c95996cb02ec\" (UID: \"ea5041b6-18a5-4f15-a28c-c95996cb02ec\") "
Jul 14 16:45:05.437293 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:05.437224    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5041b6-18a5-4f15-a28c-c95996cb02ec-kube-api-access-vgcvk" (OuterVolumeSpecName: "kube-api-access-vgcvk") pod "ea5041b6-18a5-4f15-a28c-c95996cb02ec" (UID: "ea5041b6-18a5-4f15-a28c-c95996cb02ec"). InnerVolumeSpecName "kube-api-access-vgcvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:45:05.536478 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:05.536443    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgcvk\" (UniqueName: \"kubernetes.io/projected/ea5041b6-18a5-4f15-a28c-c95996cb02ec-kube-api-access-vgcvk\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:45:06.194230 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:06.194183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5" event={"ID":"ea5041b6-18a5-4f15-a28c-c95996cb02ec","Type":"ContainerDied","Data":"1cc8cabf26125ad8295bc62c093be17e658abc0be612be1e9fcd47ecb9bf4935"}
Jul 14 16:45:06.194396 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:06.194268    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cc8cabf26125ad8295bc62c093be17e658abc0be612be1e9fcd47ecb9bf4935"
Jul 14 16:45:06.194396 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:45:06.194209    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-rttt5"
Jul 14 16:47:35.708363 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:35.708327    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"]
Jul 14 16:47:35.711194 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:35.708564    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb" podUID="252aab24-45df-456e-8218-0cdabfc492d9" containerName="manager" containerID="cri-o://ac8e397fd081fb58f304ca7e9e6b7f8a524e7663a033fea430b19bcc7d6277ac" gracePeriod=10
Jul 14 16:47:37.918653 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:37.918548    2576 generic.go:356] "Generic (PLEG): container finished" podID="252aab24-45df-456e-8218-0cdabfc492d9" containerID="ac8e397fd081fb58f304ca7e9e6b7f8a524e7663a033fea430b19bcc7d6277ac" exitCode=0
Jul 14 16:47:37.918653 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:37.918615    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb" event={"ID":"252aab24-45df-456e-8218-0cdabfc492d9","Type":"ContainerDied","Data":"ac8e397fd081fb58f304ca7e9e6b7f8a524e7663a033fea430b19bcc7d6277ac"}
Jul 14 16:47:38.261389 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.261366    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:47:38.377929 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.377902    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252aab24-45df-456e-8218-0cdabfc492d9-extensions-socket-volume\") pod \"252aab24-45df-456e-8218-0cdabfc492d9\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") "
Jul 14 16:47:38.378096 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.377950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fmz4\" (UniqueName: \"kubernetes.io/projected/252aab24-45df-456e-8218-0cdabfc492d9-kube-api-access-6fmz4\") pod \"252aab24-45df-456e-8218-0cdabfc492d9\" (UID: \"252aab24-45df-456e-8218-0cdabfc492d9\") "
Jul 14 16:47:38.378278 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.378254    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/252aab24-45df-456e-8218-0cdabfc492d9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "252aab24-45df-456e-8218-0cdabfc492d9" (UID: "252aab24-45df-456e-8218-0cdabfc492d9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:47:38.379993 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.379964    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252aab24-45df-456e-8218-0cdabfc492d9-kube-api-access-6fmz4" (OuterVolumeSpecName: "kube-api-access-6fmz4") pod "252aab24-45df-456e-8218-0cdabfc492d9" (UID: "252aab24-45df-456e-8218-0cdabfc492d9"). InnerVolumeSpecName "kube-api-access-6fmz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:47:38.479004 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.478925    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/252aab24-45df-456e-8218-0cdabfc492d9-extensions-socket-volume\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:47:38.479004 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.478952    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fmz4\" (UniqueName: \"kubernetes.io/projected/252aab24-45df-456e-8218-0cdabfc492d9-kube-api-access-6fmz4\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:47:38.925867 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.925838    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"
Jul 14 16:47:38.926324 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.925871    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb" event={"ID":"252aab24-45df-456e-8218-0cdabfc492d9","Type":"ContainerDied","Data":"7b80fd41f30bf1f6668b8636a3b1942812fe32baa5d4a16325b0312953b0b20a"}
Jul 14 16:47:38.926324 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.925926    2576 scope.go:117] "RemoveContainer" containerID="ac8e397fd081fb58f304ca7e9e6b7f8a524e7663a033fea430b19bcc7d6277ac"
Jul 14 16:47:38.950840 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.950812    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"]
Jul 14 16:47:38.957864 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:38.957838    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k7crb"]
Jul 14 16:47:40.307136 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:47:40.307100    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252aab24-45df-456e-8218-0cdabfc492d9" path="/var/lib/kubelet/pods/252aab24-45df-456e-8218-0cdabfc492d9/volumes"
Jul 14 16:48:36.968177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.968139    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"]
Jul 14 16:48:36.968609 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.968512    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea5041b6-18a5-4f15-a28c-c95996cb02ec" containerName="cleanup"
Jul 14 16:48:36.968609 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.968522    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea5041b6-18a5-4f15-a28c-c95996cb02ec" containerName="cleanup"
Jul 14 16:48:36.968609 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.968538    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252aab24-45df-456e-8218-0cdabfc492d9" containerName="manager"
Jul 14 16:48:36.968609 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.968544    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="252aab24-45df-456e-8218-0cdabfc492d9" containerName="manager"
Jul 14 16:48:36.968800 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.968656    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea5041b6-18a5-4f15-a28c-c95996cb02ec" containerName="cleanup"
Jul 14 16:48:36.968800 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.968667    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="252aab24-45df-456e-8218-0cdabfc492d9" containerName="manager"
Jul 14 16:48:36.971737 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.971721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:36.975125 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.975106    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfxsh\""
Jul 14 16:48:36.986610 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:36.986586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"]
Jul 14 16:48:37.070983 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.070935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6a9d75c-6355-4664-9758-75de34110cfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l7pcp\" (UID: \"e6a9d75c-6355-4664-9758-75de34110cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:37.071185 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.071059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmbnv\" (UniqueName: \"kubernetes.io/projected/e6a9d75c-6355-4664-9758-75de34110cfe-kube-api-access-hmbnv\") pod \"kuadrant-operator-controller-manager-86878c769f-l7pcp\" (UID: \"e6a9d75c-6355-4664-9758-75de34110cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:37.171689 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.171617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmbnv\" (UniqueName: \"kubernetes.io/projected/e6a9d75c-6355-4664-9758-75de34110cfe-kube-api-access-hmbnv\") pod \"kuadrant-operator-controller-manager-86878c769f-l7pcp\" (UID: \"e6a9d75c-6355-4664-9758-75de34110cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:37.171892 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.171757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6a9d75c-6355-4664-9758-75de34110cfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l7pcp\" (UID: \"e6a9d75c-6355-4664-9758-75de34110cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:37.172171 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.172150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6a9d75c-6355-4664-9758-75de34110cfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l7pcp\" (UID: \"e6a9d75c-6355-4664-9758-75de34110cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:37.184654 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.184613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmbnv\" (UniqueName: \"kubernetes.io/projected/e6a9d75c-6355-4664-9758-75de34110cfe-kube-api-access-hmbnv\") pod \"kuadrant-operator-controller-manager-86878c769f-l7pcp\" (UID: \"e6a9d75c-6355-4664-9758-75de34110cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:37.281844 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.281812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:37.427488 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:37.427454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"]
Jul 14 16:48:37.431119 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:48:37.431087    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a9d75c_6355_4664_9758_75de34110cfe.slice/crio-6ca6a9f703c50b2dfbdfb56d4513cb08b8274c3f6082581ea13721195d1bc5e7 WatchSource:0}: Error finding container 6ca6a9f703c50b2dfbdfb56d4513cb08b8274c3f6082581ea13721195d1bc5e7: Status 404 returned error can't find the container with id 6ca6a9f703c50b2dfbdfb56d4513cb08b8274c3f6082581ea13721195d1bc5e7
Jul 14 16:48:38.195980 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:38.195947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp" event={"ID":"e6a9d75c-6355-4664-9758-75de34110cfe","Type":"ContainerStarted","Data":"60ae2b2bd3886a0c9a00f44f451e22dbae5d89291151c3db57c3201797090e14"}
Jul 14 16:48:38.196380 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:38.196003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp" event={"ID":"e6a9d75c-6355-4664-9758-75de34110cfe","Type":"ContainerStarted","Data":"6ca6a9f703c50b2dfbdfb56d4513cb08b8274c3f6082581ea13721195d1bc5e7"}
Jul 14 16:48:38.196380 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:38.196029    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:48:38.222452 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:38.222409    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp" podStartSLOduration=2.222395089 podStartE2EDuration="2.222395089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:48:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:48:38.221193203 +0000 UTC m=+1107.351177426" watchObservedRunningTime="2026-07-14 16:48:38.222395089 +0000 UTC m=+1107.352379318"
Jul 14 16:48:49.203420 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:48:49.203386    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7pcp"
Jul 14 16:55:01.372522 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.372486    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"]
Jul 14 16:55:01.376174 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.376155    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.383525 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:01.383499    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-e2e-ait-47ef20f4-serving-cert\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-47ef20f4-serving-cert\"" type="*v1.Secret"
Jul 14 16:55:01.391068 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:01.391042    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" is forbidden: User \"system:node:ip-10-0-141-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-173.ec2.internal' and this object" podUID="c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.411579 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.411552    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"]
Jul 14 16:55:01.458317 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.458290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsv7p\" (UniqueName: \"kubernetes.io/projected/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-kube-api-access-rsv7p\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.458469 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.458327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-maas-api-tls\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.458534 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.458459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-openshift-service-ca\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.559246 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.559208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsv7p\" (UniqueName: \"kubernetes.io/projected/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-kube-api-access-rsv7p\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.559443 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.559265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-maas-api-tls\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.559443 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.559302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-openshift-service-ca\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.559982 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.559959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-openshift-service-ca\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:01.606599 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:01.606568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsv7p\" (UniqueName: \"kubernetes.io/projected/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-kube-api-access-rsv7p\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:02.383081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:02.383054    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-47ef20f4-serving-cert\""
Jul 14 16:55:02.392668 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:02.392640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-maas-api-tls\") pod \"maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") " pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:02.585878 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:02.585850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:02.736296 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:02.736270    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"]
Jul 14 16:55:02.737885 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:55:02.737859    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10a4bf5_2f90_49f7_80b4_a259cf05a6b2.slice/crio-6be177bec367aab37d5c1aeba789a048caf4a43610f659fd21f062faa03219cc WatchSource:0}: Error finding container 6be177bec367aab37d5c1aeba789a048caf4a43610f659fd21f062faa03219cc: Status 404 returned error can't find the container with id 6be177bec367aab37d5c1aeba789a048caf4a43610f659fd21f062faa03219cc
Jul 14 16:55:02.739504 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:02.739487    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:55:02.974958 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:02.974870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh" event={"ID":"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2","Type":"ContainerStarted","Data":"6be177bec367aab37d5c1aeba789a048caf4a43610f659fd21f062faa03219cc"}
Jul 14 16:55:03.981138 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:03.981095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh" event={"ID":"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2","Type":"ContainerStarted","Data":"580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70"}
Jul 14 16:55:03.981499 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:03.981229    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:04.007465 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:04.007419    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh" podStartSLOduration=2.412710402 podStartE2EDuration="3.007403378s" totalImagesPullingTime="594.692976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:55:04.007235101 +0000 UTC m=+1493.137219302" watchObservedRunningTime="2026-07-14 16:55:04.007403378 +0000 UTC m=+1493.137387577"
Jul 14 16:55:06.681204 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.681173    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"]
Jul 14 16:55:06.681636 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.681343    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh" podUID="c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" containerName="maas-api" containerID="cri-o://580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70" gracePeriod=30
Jul 14 16:55:06.935154 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.935090    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:06.997079 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.997045    2576 generic.go:356] "Generic (PLEG): container finished" podID="c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" containerID="580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70" exitCode=0
Jul 14 16:55:06.997230 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.997091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"
Jul 14 16:55:06.997230 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.997126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh" event={"ID":"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2","Type":"ContainerDied","Data":"580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70"}
Jul 14 16:55:06.997230 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.997183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh" event={"ID":"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2","Type":"ContainerDied","Data":"6be177bec367aab37d5c1aeba789a048caf4a43610f659fd21f062faa03219cc"}
Jul 14 16:55:06.997230 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:06.997205    2576 scope.go:117] "RemoveContainer" containerID="580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70"
Jul 14 16:55:07.005788 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.005765    2576 scope.go:117] "RemoveContainer" containerID="580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70"
Jul 14 16:55:07.006052 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:07.006033    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70\": container with ID starting with 580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70 not found: ID does not exist" containerID="580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70"
Jul 14 16:55:07.006118 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.006062    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70"} err="failed to get container status \"580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70\": rpc error: code = NotFound desc = could not find container \"580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70\": container with ID starting with 580652182b67517b73bf0d2081bb0039bde6ea5ed009d5c4d5808c87049e9f70 not found: ID does not exist"
Jul 14 16:55:07.109394 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.109359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-openshift-service-ca\") pod \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") "
Jul 14 16:55:07.109394 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.109391    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-maas-api-tls\") pod \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") "
Jul 14 16:55:07.109649 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.109453    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsv7p\" (UniqueName: \"kubernetes.io/projected/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-kube-api-access-rsv7p\") pod \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\" (UID: \"c10a4bf5-2f90-49f7-80b4-a259cf05a6b2\") "
Jul 14 16:55:07.109755 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.109733    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" (UID: "c10a4bf5-2f90-49f7-80b4-a259cf05a6b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:55:07.111513 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.111484    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-kube-api-access-rsv7p" (OuterVolumeSpecName: "kube-api-access-rsv7p") pod "c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" (UID: "c10a4bf5-2f90-49f7-80b4-a259cf05a6b2"). InnerVolumeSpecName "kube-api-access-rsv7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:55:07.111647 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.111589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" (UID: "c10a4bf5-2f90-49f7-80b4-a259cf05a6b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:55:07.210103 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.210008    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:07.210103 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.210043    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:07.210103 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.210056    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsv7p\" (UniqueName: \"kubernetes.io/projected/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2-kube-api-access-rsv7p\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:07.320230 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.320198    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"]
Jul 14 16:55:07.323349 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:07.323321    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-47ef20f4-659c9fbc69-8tslh"]
Jul 14 16:55:08.307376 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:08.307341    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" path="/var/lib/kubelet/pods/c10a4bf5-2f90-49f7-80b4-a259cf05a6b2/volumes"
Jul 14 16:55:15.189731 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.189692    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"]
Jul 14 16:55:15.190092 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.190079    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" containerName="maas-api"
Jul 14 16:55:15.190092 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.190093    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" containerName="maas-api"
Jul 14 16:55:15.190179 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.190165    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c10a4bf5-2f90-49f7-80b4-a259cf05a6b2" containerName="maas-api"
Jul 14 16:55:15.194454 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.194429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.197282 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.197252    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-def21b00-serving-cert\""
Jul 14 16:55:15.214232 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.214210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"]
Jul 14 16:55:15.275738 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.275699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.275910 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.275801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464f360-f42f-4dce-9988-a6e7287141a0-openshift-service-ca\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.275910 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.275830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfx7l\" (UniqueName: \"kubernetes.io/projected/6464f360-f42f-4dce-9988-a6e7287141a0-kube-api-access-qfx7l\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.376788 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.376746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.376981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.376850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464f360-f42f-4dce-9988-a6e7287141a0-openshift-service-ca\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.376981 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.376874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfx7l\" (UniqueName: \"kubernetes.io/projected/6464f360-f42f-4dce-9988-a6e7287141a0-kube-api-access-qfx7l\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.376981 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:15.376924    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-def21b00-serving-cert: secret "maas-api-e2e-ait-def21b00-serving-cert" not found
Jul 14 16:55:15.377146 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:15.377001    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls podName:6464f360-f42f-4dce-9988-a6e7287141a0 nodeName:}" failed. No retries permitted until 2026-07-14 16:55:15.876984387 +0000 UTC m=+1505.006968567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls") pod "maas-api-e2e-ait-def21b00-59ff588b99-cmnch" (UID: "6464f360-f42f-4dce-9988-a6e7287141a0") : secret "maas-api-e2e-ait-def21b00-serving-cert" not found
Jul 14 16:55:15.377453 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.377431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464f360-f42f-4dce-9988-a6e7287141a0-openshift-service-ca\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.395270 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.395243    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfx7l\" (UniqueName: \"kubernetes.io/projected/6464f360-f42f-4dce-9988-a6e7287141a0-kube-api-access-qfx7l\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.880944 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:15.880913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:15.881106 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:15.881017    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-def21b00-serving-cert: secret "maas-api-e2e-ait-def21b00-serving-cert" not found
Jul 14 16:55:15.881106 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:15.881078    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls podName:6464f360-f42f-4dce-9988-a6e7287141a0 nodeName:}" failed. No retries permitted until 2026-07-14 16:55:16.881065112 +0000 UTC m=+1506.011049289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls") pod "maas-api-e2e-ait-def21b00-59ff588b99-cmnch" (UID: "6464f360-f42f-4dce-9988-a6e7287141a0") : secret "maas-api-e2e-ait-def21b00-serving-cert" not found
Jul 14 16:55:16.891059 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:16.891022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:16.893325 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:16.893304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls\") pod \"maas-api-e2e-ait-def21b00-59ff588b99-cmnch\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") " pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:17.006540 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:17.006448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:17.162615 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:17.162590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"]
Jul 14 16:55:17.164817 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:55:17.164786    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6464f360_f42f_4dce_9988_a6e7287141a0.slice/crio-237806fcb79aba1a62a114c1c485f5ee3577ddc6287b6ab6958b5fd4ed69b77b WatchSource:0}: Error finding container 237806fcb79aba1a62a114c1c485f5ee3577ddc6287b6ab6958b5fd4ed69b77b: Status 404 returned error can't find the container with id 237806fcb79aba1a62a114c1c485f5ee3577ddc6287b6ab6958b5fd4ed69b77b
Jul 14 16:55:18.057530 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:18.057493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch" event={"ID":"6464f360-f42f-4dce-9988-a6e7287141a0","Type":"ContainerStarted","Data":"9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b"}
Jul 14 16:55:18.057987 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:18.057548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch" event={"ID":"6464f360-f42f-4dce-9988-a6e7287141a0","Type":"ContainerStarted","Data":"237806fcb79aba1a62a114c1c485f5ee3577ddc6287b6ab6958b5fd4ed69b77b"}
Jul 14 16:55:18.057987 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:18.057575    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:18.084967 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:18.084926    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch" podStartSLOduration=2.317883921 podStartE2EDuration="3.084907922s" totalImagesPullingTime="767.024001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:55:18.084753641 +0000 UTC m=+1507.214737841" watchObservedRunningTime="2026-07-14 16:55:18.084907922 +0000 UTC m=+1507.214892121"
Jul 14 16:55:20.573916 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.573886    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"]
Jul 14 16:55:20.574410 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.574105    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch" podUID="6464f360-f42f-4dce-9988-a6e7287141a0" containerName="maas-api" containerID="cri-o://9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b" gracePeriod=30
Jul 14 16:55:20.825955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.825901    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:20.926754 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.926722    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfx7l\" (UniqueName: \"kubernetes.io/projected/6464f360-f42f-4dce-9988-a6e7287141a0-kube-api-access-qfx7l\") pod \"6464f360-f42f-4dce-9988-a6e7287141a0\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") "
Jul 14 16:55:20.926922 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.926765    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls\") pod \"6464f360-f42f-4dce-9988-a6e7287141a0\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") "
Jul 14 16:55:20.926922 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.926783    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464f360-f42f-4dce-9988-a6e7287141a0-openshift-service-ca\") pod \"6464f360-f42f-4dce-9988-a6e7287141a0\" (UID: \"6464f360-f42f-4dce-9988-a6e7287141a0\") "
Jul 14 16:55:20.927161 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.927140    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6464f360-f42f-4dce-9988-a6e7287141a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6464f360-f42f-4dce-9988-a6e7287141a0" (UID: "6464f360-f42f-4dce-9988-a6e7287141a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:55:20.928777 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.928752    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6464f360-f42f-4dce-9988-a6e7287141a0" (UID: "6464f360-f42f-4dce-9988-a6e7287141a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:55:20.928887 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:20.928865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6464f360-f42f-4dce-9988-a6e7287141a0-kube-api-access-qfx7l" (OuterVolumeSpecName: "kube-api-access-qfx7l") pod "6464f360-f42f-4dce-9988-a6e7287141a0" (UID: "6464f360-f42f-4dce-9988-a6e7287141a0"). InnerVolumeSpecName "kube-api-access-qfx7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:55:21.027573 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.027537    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfx7l\" (UniqueName: \"kubernetes.io/projected/6464f360-f42f-4dce-9988-a6e7287141a0-kube-api-access-qfx7l\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:21.027573 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.027566    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464f360-f42f-4dce-9988-a6e7287141a0-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:21.027573 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.027575    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464f360-f42f-4dce-9988-a6e7287141a0-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:21.073057 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.073024    2576 generic.go:356] "Generic (PLEG): container finished" podID="6464f360-f42f-4dce-9988-a6e7287141a0" containerID="9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b" exitCode=0
Jul 14 16:55:21.073210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.073071    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"
Jul 14 16:55:21.073210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.073110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch" event={"ID":"6464f360-f42f-4dce-9988-a6e7287141a0","Type":"ContainerDied","Data":"9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b"}
Jul 14 16:55:21.073210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.073166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch" event={"ID":"6464f360-f42f-4dce-9988-a6e7287141a0","Type":"ContainerDied","Data":"237806fcb79aba1a62a114c1c485f5ee3577ddc6287b6ab6958b5fd4ed69b77b"}
Jul 14 16:55:21.073210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.073187    2576 scope.go:117] "RemoveContainer" containerID="9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b"
Jul 14 16:55:21.081989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.081972    2576 scope.go:117] "RemoveContainer" containerID="9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b"
Jul 14 16:55:21.082247 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:21.082228    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b\": container with ID starting with 9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b not found: ID does not exist" containerID="9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b"
Jul 14 16:55:21.082291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.082256    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b"} err="failed to get container status \"9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b\": rpc error: code = NotFound desc = could not find container \"9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b\": container with ID starting with 9e142272b71be8c63a885ed8480cc05fc3d40094eb8cf540b48b328f8b7fcc2b not found: ID does not exist"
Jul 14 16:55:21.100803 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.100783    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"]
Jul 14 16:55:21.107353 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:21.107332    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-def21b00-59ff588b99-cmnch"]
Jul 14 16:55:22.306372 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:22.306335    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6464f360-f42f-4dce-9988-a6e7287141a0" path="/var/lib/kubelet/pods/6464f360-f42f-4dce-9988-a6e7287141a0/volumes"
Jul 14 16:55:35.551790 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.551752    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"]
Jul 14 16:55:35.552223 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.552186    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6464f360-f42f-4dce-9988-a6e7287141a0" containerName="maas-api"
Jul 14 16:55:35.552223 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.552200    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6464f360-f42f-4dce-9988-a6e7287141a0" containerName="maas-api"
Jul 14 16:55:35.552298 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.552276    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6464f360-f42f-4dce-9988-a6e7287141a0" containerName="maas-api"
Jul 14 16:55:35.556798 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.556781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.559529 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.559512    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-07afec54-serving-cert\""
Jul 14 16:55:35.577203 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.577169    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"]
Jul 14 16:55:35.657814 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.657780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmpn\" (UniqueName: \"kubernetes.io/projected/ea110cac-633a-438b-b40b-dab92f8be819-kube-api-access-7bmpn\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.657814 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.657816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.658008 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.657839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea110cac-633a-438b-b40b-dab92f8be819-openshift-service-ca\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.758407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.758372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmpn\" (UniqueName: \"kubernetes.io/projected/ea110cac-633a-438b-b40b-dab92f8be819-kube-api-access-7bmpn\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.758407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.758409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.758606 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.758438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea110cac-633a-438b-b40b-dab92f8be819-openshift-service-ca\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.758606 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:35.758545    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-07afec54-serving-cert: secret "maas-api-e2e-derive-07afec54-serving-cert" not found
Jul 14 16:55:35.758719 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:35.758609    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls podName:ea110cac-633a-438b-b40b-dab92f8be819 nodeName:}" failed. No retries permitted until 2026-07-14 16:55:36.258591528 +0000 UTC m=+1525.388575706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls") pod "maas-api-e2e-derive-07afec54-7887dc6755-phxhs" (UID: "ea110cac-633a-438b-b40b-dab92f8be819") : secret "maas-api-e2e-derive-07afec54-serving-cert" not found
Jul 14 16:55:35.759114 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.759096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea110cac-633a-438b-b40b-dab92f8be819-openshift-service-ca\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:35.774242 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:35.774209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmpn\" (UniqueName: \"kubernetes.io/projected/ea110cac-633a-438b-b40b-dab92f8be819-kube-api-access-7bmpn\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:36.263358 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:36.263322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:36.265839 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:36.265810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls\") pod \"maas-api-e2e-derive-07afec54-7887dc6755-phxhs\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") " pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:36.466678 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:36.466602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:36.613643 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:55:36.613597    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea110cac_633a_438b_b40b_dab92f8be819.slice/crio-ca68e56aed3d9514e7c9123850b983582584c781f2c3322a14b04e2abd193d80 WatchSource:0}: Error finding container ca68e56aed3d9514e7c9123850b983582584c781f2c3322a14b04e2abd193d80: Status 404 returned error can't find the container with id ca68e56aed3d9514e7c9123850b983582584c781f2c3322a14b04e2abd193d80
Jul 14 16:55:36.614035 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:36.613946    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"]
Jul 14 16:55:37.152927 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:37.152892    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs" event={"ID":"ea110cac-633a-438b-b40b-dab92f8be819","Type":"ContainerStarted","Data":"ca68e56aed3d9514e7c9123850b983582584c781f2c3322a14b04e2abd193d80"}
Jul 14 16:55:39.163530 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:39.163497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs" event={"ID":"ea110cac-633a-438b-b40b-dab92f8be819","Type":"ContainerStarted","Data":"75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7"}
Jul 14 16:55:39.163941 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:39.163654    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:39.198364 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:39.198319    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs" podStartSLOduration=2.4160087519999998 podStartE2EDuration="4.198305741s" totalImagesPullingTime="1.782296989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:55:39.194979239 +0000 UTC m=+1528.324963452" watchObservedRunningTime="2026-07-14 16:55:39.198305741 +0000 UTC m=+1528.328289942"
Jul 14 16:55:40.363484 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:40.363451    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"]
Jul 14 16:55:41.173793 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.173750    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs" podUID="ea110cac-633a-438b-b40b-dab92f8be819" containerName="maas-api" containerID="cri-o://75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7" gracePeriod=30
Jul 14 16:55:41.424327 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.424266    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:41.510786 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.510751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea110cac-633a-438b-b40b-dab92f8be819-openshift-service-ca\") pod \"ea110cac-633a-438b-b40b-dab92f8be819\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") "
Jul 14 16:55:41.510951 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.510815    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls\") pod \"ea110cac-633a-438b-b40b-dab92f8be819\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") "
Jul 14 16:55:41.510951 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.510839    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bmpn\" (UniqueName: \"kubernetes.io/projected/ea110cac-633a-438b-b40b-dab92f8be819-kube-api-access-7bmpn\") pod \"ea110cac-633a-438b-b40b-dab92f8be819\" (UID: \"ea110cac-633a-438b-b40b-dab92f8be819\") "
Jul 14 16:55:41.511168 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.511145    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea110cac-633a-438b-b40b-dab92f8be819-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea110cac-633a-438b-b40b-dab92f8be819" (UID: "ea110cac-633a-438b-b40b-dab92f8be819"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:55:41.513232 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.513189    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea110cac-633a-438b-b40b-dab92f8be819" (UID: "ea110cac-633a-438b-b40b-dab92f8be819"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:55:41.513360 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.513300    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea110cac-633a-438b-b40b-dab92f8be819-kube-api-access-7bmpn" (OuterVolumeSpecName: "kube-api-access-7bmpn") pod "ea110cac-633a-438b-b40b-dab92f8be819" (UID: "ea110cac-633a-438b-b40b-dab92f8be819"). InnerVolumeSpecName "kube-api-access-7bmpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:55:41.611920 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.611880    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea110cac-633a-438b-b40b-dab92f8be819-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:41.611920 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.611911    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea110cac-633a-438b-b40b-dab92f8be819-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:41.611920 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:41.611921    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bmpn\" (UniqueName: \"kubernetes.io/projected/ea110cac-633a-438b-b40b-dab92f8be819-kube-api-access-7bmpn\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:55:42.179926 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.179891    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea110cac-633a-438b-b40b-dab92f8be819" containerID="75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7" exitCode=0
Jul 14 16:55:42.180177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.179938    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"
Jul 14 16:55:42.180177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.179947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs" event={"ID":"ea110cac-633a-438b-b40b-dab92f8be819","Type":"ContainerDied","Data":"75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7"}
Jul 14 16:55:42.180177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.180002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs" event={"ID":"ea110cac-633a-438b-b40b-dab92f8be819","Type":"ContainerDied","Data":"ca68e56aed3d9514e7c9123850b983582584c781f2c3322a14b04e2abd193d80"}
Jul 14 16:55:42.180177 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.180033    2576 scope.go:117] "RemoveContainer" containerID="75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7"
Jul 14 16:55:42.188968 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.188948    2576 scope.go:117] "RemoveContainer" containerID="75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7"
Jul 14 16:55:42.189257 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:55:42.189230    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7\": container with ID starting with 75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7 not found: ID does not exist" containerID="75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7"
Jul 14 16:55:42.189304 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.189267    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7"} err="failed to get container status \"75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7\": rpc error: code = NotFound desc = could not find container \"75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7\": container with ID starting with 75b0b9352a44af075cbd59fae66bc64279d6ea455c27d1b4dbd9bcbe68fa73d7 not found: ID does not exist"
Jul 14 16:55:42.211899 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.211862    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"]
Jul 14 16:55:42.213819 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.213798    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-07afec54-7887dc6755-phxhs"]
Jul 14 16:55:42.311537 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:55:42.311500    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea110cac-633a-438b-b40b-dab92f8be819" path="/var/lib/kubelet/pods/ea110cac-633a-438b-b40b-dab92f8be819/volumes"
Jul 14 16:57:36.273607 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.273529    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"]
Jul 14 16:57:36.274095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.274014    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea110cac-633a-438b-b40b-dab92f8be819" containerName="maas-api"
Jul 14 16:57:36.274095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.274029    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea110cac-633a-438b-b40b-dab92f8be819" containerName="maas-api"
Jul 14 16:57:36.274095 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.274087    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea110cac-633a-438b-b40b-dab92f8be819" containerName="maas-api"
Jul 14 16:57:36.277117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.277101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.280910 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.280891    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-4f8cd5c4-serving-cert\""
Jul 14 16:57:36.307577 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.307553    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"]
Jul 14 16:57:36.400404 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.400372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-openshift-service-ca\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.400573 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.400472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-645wf\" (UniqueName: \"kubernetes.io/projected/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-kube-api-access-645wf\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.400653 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.400592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.501548 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.501512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-645wf\" (UniqueName: \"kubernetes.io/projected/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-kube-api-access-645wf\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.501736 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.501578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.501736 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.501687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-openshift-service-ca\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.501825 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:57:36.501731    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-4f8cd5c4-serving-cert: secret "maas-api-e2e-mt-4f8cd5c4-serving-cert" not found
Jul 14 16:57:36.501825 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:57:36.501804    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls podName:e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4 nodeName:}" failed. No retries permitted until 2026-07-14 16:57:37.001788149 +0000 UTC m=+1646.131772328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls") pod "maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q" (UID: "e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4") : secret "maas-api-e2e-mt-4f8cd5c4-serving-cert" not found
Jul 14 16:57:36.502301 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.502283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-openshift-service-ca\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:36.523331 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:36.523305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-645wf\" (UniqueName: \"kubernetes.io/projected/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-kube-api-access-645wf\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:37.007152 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:37.007112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:37.009471 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:37.009447    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls\") pod \"maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") " pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:37.186882 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:37.186842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:37.341315 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:37.341285    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"]
Jul 14 16:57:37.343658 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:57:37.343596    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a74aa6_90ad_4d6b_a108_0cc2a3f36ed4.slice/crio-a205d91b1d815cce71ec80390e6f4bb80b2da932e334e4da1309f6b5046c53a6 WatchSource:0}: Error finding container a205d91b1d815cce71ec80390e6f4bb80b2da932e334e4da1309f6b5046c53a6: Status 404 returned error can't find the container with id a205d91b1d815cce71ec80390e6f4bb80b2da932e334e4da1309f6b5046c53a6
Jul 14 16:57:37.720972 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:37.720883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q" event={"ID":"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4","Type":"ContainerStarted","Data":"a205d91b1d815cce71ec80390e6f4bb80b2da932e334e4da1309f6b5046c53a6"}
Jul 14 16:57:38.727123 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:38.727086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q" event={"ID":"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4","Type":"ContainerStarted","Data":"700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7"}
Jul 14 16:57:38.727543 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:38.727168    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:38.752690 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:38.752639    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q" podStartSLOduration=2.216293644 podStartE2EDuration="2.752605518s" totalImagesPullingTime="536.311874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:57:38.749400486 +0000 UTC m=+1647.879384698" watchObservedRunningTime="2026-07-14 16:57:38.752605518 +0000 UTC m=+1647.882589721"
Jul 14 16:57:44.738417 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:44.738381    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:49.339687 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.339649    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"]
Jul 14 16:57:49.340103 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.339888    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q" podUID="e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" containerName="maas-api" containerID="cri-o://700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7" gracePeriod=30
Jul 14 16:57:49.582126 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.582101    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:49.623498 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.623422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls\") pod \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") "
Jul 14 16:57:49.623498 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.623479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-645wf\" (UniqueName: \"kubernetes.io/projected/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-kube-api-access-645wf\") pod \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") "
Jul 14 16:57:49.623762 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.623574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-openshift-service-ca\") pod \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\" (UID: \"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4\") "
Jul 14 16:57:49.623955 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.623929    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" (UID: "e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:57:49.625595 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.625560    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-kube-api-access-645wf" (OuterVolumeSpecName: "kube-api-access-645wf") pod "e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" (UID: "e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4"). InnerVolumeSpecName "kube-api-access-645wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:57:49.625773 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.625611    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" (UID: "e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:57:49.725081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.725053    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:57:49.725081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.725080    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:57:49.725081 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.725092    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-645wf\" (UniqueName: \"kubernetes.io/projected/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4-kube-api-access-645wf\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:57:49.785240 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.785208    2576 generic.go:356] "Generic (PLEG): container finished" podID="e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" containerID="700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7" exitCode=0
Jul 14 16:57:49.785407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.785247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q" event={"ID":"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4","Type":"ContainerDied","Data":"700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7"}
Jul 14 16:57:49.785407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.785255    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"
Jul 14 16:57:49.785407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.785287    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q" event={"ID":"e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4","Type":"ContainerDied","Data":"a205d91b1d815cce71ec80390e6f4bb80b2da932e334e4da1309f6b5046c53a6"}
Jul 14 16:57:49.785407 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.785309    2576 scope.go:117] "RemoveContainer" containerID="700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7"
Jul 14 16:57:49.794385 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.794369    2576 scope.go:117] "RemoveContainer" containerID="700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7"
Jul 14 16:57:49.794688 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:57:49.794668    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7\": container with ID starting with 700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7 not found: ID does not exist" containerID="700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7"
Jul 14 16:57:49.794755 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.794697    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7"} err="failed to get container status \"700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7\": rpc error: code = NotFound desc = could not find container \"700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7\": container with ID starting with 700355bbe6be47f32c69631e093189309b3e02b47da7101534395bba370f93d7 not found: ID does not exist"
Jul 14 16:57:49.811828 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.811803    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"]
Jul 14 16:57:49.815639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:49.815607    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-4f8cd5c4-bccc75869-7967q"]
Jul 14 16:57:50.306639 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:57:50.306597    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" path="/var/lib/kubelet/pods/e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4/volumes"
Jul 14 16:58:23.277057 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.277024    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"]
Jul 14 16:58:23.277500 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.277484    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" containerName="maas-api"
Jul 14 16:58:23.277500 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.277500    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" containerName="maas-api"
Jul 14 16:58:23.277603 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.277566    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a74aa6-90ad-4d6b-a108-0cc2a3f36ed4" containerName="maas-api"
Jul 14 16:58:23.280546 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.280525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.283678 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.283658    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-5d77ea9b-serving-cert\""
Jul 14 16:58:23.298750 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.298728    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"]
Jul 14 16:58:23.434980 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.434937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36c17792-96db-4787-8f5d-d35545cd93e2-openshift-service-ca\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.435186 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.435099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.435186 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.435125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft9tf\" (UniqueName: \"kubernetes.io/projected/36c17792-96db-4787-8f5d-d35545cd93e2-kube-api-access-ft9tf\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.536611 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.536507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.536611 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.536554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9tf\" (UniqueName: \"kubernetes.io/projected/36c17792-96db-4787-8f5d-d35545cd93e2-kube-api-access-ft9tf\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.536829 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.536655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36c17792-96db-4787-8f5d-d35545cd93e2-openshift-service-ca\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.536829 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:58:23.536676    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-5d77ea9b-serving-cert: secret "maas-api-e2e-mt-5d77ea9b-serving-cert" not found
Jul 14 16:58:23.536829 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:58:23.536749    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls podName:36c17792-96db-4787-8f5d-d35545cd93e2 nodeName:}" failed. No retries permitted until 2026-07-14 16:58:24.036728129 +0000 UTC m=+1693.166712311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls") pod "maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" (UID: "36c17792-96db-4787-8f5d-d35545cd93e2") : secret "maas-api-e2e-mt-5d77ea9b-serving-cert" not found
Jul 14 16:58:23.537282 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.537263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36c17792-96db-4787-8f5d-d35545cd93e2-openshift-service-ca\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:23.555795 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:23.555766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft9tf\" (UniqueName: \"kubernetes.io/projected/36c17792-96db-4787-8f5d-d35545cd93e2-kube-api-access-ft9tf\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:24.041989 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:24.041950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:24.044588 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:24.044561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls\") pod \"maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") " pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:24.190291 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:24.190259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:24.336477 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:24.336402    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"]
Jul 14 16:58:24.341401 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:58:24.341374    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c17792_96db_4787_8f5d_d35545cd93e2.slice/crio-30d152bb350c72996d28c0793e391c7940b2f901f09367f605a3f03d1095e7dc WatchSource:0}: Error finding container 30d152bb350c72996d28c0793e391c7940b2f901f09367f605a3f03d1095e7dc: Status 404 returned error can't find the container with id 30d152bb350c72996d28c0793e391c7940b2f901f09367f605a3f03d1095e7dc
Jul 14 16:58:24.951386 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:24.951354    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" event={"ID":"36c17792-96db-4787-8f5d-d35545cd93e2","Type":"ContainerStarted","Data":"30d152bb350c72996d28c0793e391c7940b2f901f09367f605a3f03d1095e7dc"}
Jul 14 16:58:25.957728 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:25.957694    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" event={"ID":"36c17792-96db-4787-8f5d-d35545cd93e2","Type":"ContainerStarted","Data":"0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4"}
Jul 14 16:58:25.958117 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:25.957826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:25.992006 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:25.991965    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" podStartSLOduration=2.234855603 podStartE2EDuration="2.991950659s" totalImagesPullingTime="757.095056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:58:25.990463477 +0000 UTC m=+1695.120447690" watchObservedRunningTime="2026-07-14 16:58:25.991950659 +0000 UTC m=+1695.121934858"
Jul 14 16:58:31.968738 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:31.968706    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:58:41.625887 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.625804    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"]
Jul 14 16:58:41.629428 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.629405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.633745 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.633720    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5d77ea9b\"/\"openshift-service-ca.crt\""
Jul 14 16:58:41.633880 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.633774    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5d77ea9b\"/\"kube-root-ca.crt\""
Jul 14 16:58:41.633880 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.633826    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5d77ea9b\"/\"e2e-lifecycle-model-5d77ea9b-kserve-self-signed-certs\""
Jul 14 16:58:41.633880 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.633837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5d77ea9b\"/\"default-dockercfg-n5tcr\""
Jul 14 16:58:41.646994 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.646963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"]
Jul 14 16:58:41.694691 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.694663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053f1251-38de-443e-837c-2a5d1073f279-tls-certs\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.694868 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.694703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgfdv\" (UniqueName: \"kubernetes.io/projected/053f1251-38de-443e-837c-2a5d1073f279-kube-api-access-vgfdv\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.694868 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.694802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-dshm\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.694868 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.694845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-home\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.694988 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.694869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-tmp-dir\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.694988 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.694961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-model-cache\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796113 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-model-cache\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796113 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053f1251-38de-443e-837c-2a5d1073f279-tls-certs\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796354 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgfdv\" (UniqueName: \"kubernetes.io/projected/053f1251-38de-443e-837c-2a5d1073f279-kube-api-access-vgfdv\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796354 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-dshm\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796354 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-home\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796354 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-tmp-dir\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796570 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-model-cache\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796650 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-tmp-dir\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.796748 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.796666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-home\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.798497 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.798474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-dshm\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.798612 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.798596    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053f1251-38de-443e-837c-2a5d1073f279-tls-certs\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.811075 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.811052    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgfdv\" (UniqueName: \"kubernetes.io/projected/053f1251-38de-443e-837c-2a5d1073f279-kube-api-access-vgfdv\") pod \"e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") " pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:41.938837 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:41.938750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:42.084222 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:42.084199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"]
Jul 14 16:58:42.086532 ip-10-0-141-173 kubenswrapper[2576]: W0714 16:58:42.086506    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod053f1251_38de_443e_837c_2a5d1073f279.slice/crio-1fdede6d99d8ac50a2b389ce262121a2198df1f8fcae0dc4b76f30a5b3c4eb63 WatchSource:0}: Error finding container 1fdede6d99d8ac50a2b389ce262121a2198df1f8fcae0dc4b76f30a5b3c4eb63: Status 404 returned error can't find the container with id 1fdede6d99d8ac50a2b389ce262121a2198df1f8fcae0dc4b76f30a5b3c4eb63
Jul 14 16:58:43.042531 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:43.042494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w" event={"ID":"053f1251-38de-443e-837c-2a5d1073f279","Type":"ContainerStarted","Data":"11cdf7d56c58bca98a3525d06288decd9200cb04ecf223c7666801477be83f4b"}
Jul 14 16:58:43.042531 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:43.042536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w" event={"ID":"053f1251-38de-443e-837c-2a5d1073f279","Type":"ContainerStarted","Data":"1fdede6d99d8ac50a2b389ce262121a2198df1f8fcae0dc4b76f30a5b3c4eb63"}
Jul 14 16:58:43.069805 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:43.069757    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w" podStartSLOduration=2.069742134 podStartE2EDuration="2.069742134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:58:43.06937989 +0000 UTC m=+1712.199364103" watchObservedRunningTime="2026-07-14 16:58:43.069742134 +0000 UTC m=+1712.199726333"
Jul 14 16:58:51.939084 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:51.939048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:51.939648 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:51.939108    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:51.951851 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:51.951827    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:58:52.098586 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:58:52.098549    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:59:11.786968 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:11.786929    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"]
Jul 14 16:59:11.787454 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:11.787130    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" podUID="36c17792-96db-4787-8f5d-d35545cd93e2" containerName="maas-api" containerID="cri-o://0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4" gracePeriod=30
Jul 14 16:59:12.040093 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.040027    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:59:12.078729 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.078705    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36c17792-96db-4787-8f5d-d35545cd93e2-openshift-service-ca\") pod \"36c17792-96db-4787-8f5d-d35545cd93e2\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") "
Jul 14 16:59:12.078870 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.078745    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls\") pod \"36c17792-96db-4787-8f5d-d35545cd93e2\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") "
Jul 14 16:59:12.078870 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.078770    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft9tf\" (UniqueName: \"kubernetes.io/projected/36c17792-96db-4787-8f5d-d35545cd93e2-kube-api-access-ft9tf\") pod \"36c17792-96db-4787-8f5d-d35545cd93e2\" (UID: \"36c17792-96db-4787-8f5d-d35545cd93e2\") "
Jul 14 16:59:12.079067 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.079043    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c17792-96db-4787-8f5d-d35545cd93e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36c17792-96db-4787-8f5d-d35545cd93e2" (UID: "36c17792-96db-4787-8f5d-d35545cd93e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:59:12.080893 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.080870    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c17792-96db-4787-8f5d-d35545cd93e2-kube-api-access-ft9tf" (OuterVolumeSpecName: "kube-api-access-ft9tf") pod "36c17792-96db-4787-8f5d-d35545cd93e2" (UID: "36c17792-96db-4787-8f5d-d35545cd93e2"). InnerVolumeSpecName "kube-api-access-ft9tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:59:12.080984 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.080952    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36c17792-96db-4787-8f5d-d35545cd93e2" (UID: "36c17792-96db-4787-8f5d-d35545cd93e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:59:12.179473 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.179442    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36c17792-96db-4787-8f5d-d35545cd93e2-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:12.179473 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.179474    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36c17792-96db-4787-8f5d-d35545cd93e2-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:12.179665 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.179490    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft9tf\" (UniqueName: \"kubernetes.io/projected/36c17792-96db-4787-8f5d-d35545cd93e2-kube-api-access-ft9tf\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:12.185391 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.185357    2576 generic.go:356] "Generic (PLEG): container finished" podID="36c17792-96db-4787-8f5d-d35545cd93e2" containerID="0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4" exitCode=0
Jul 14 16:59:12.185519 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.185409    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"
Jul 14 16:59:12.185519 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.185419    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" event={"ID":"36c17792-96db-4787-8f5d-d35545cd93e2","Type":"ContainerDied","Data":"0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4"}
Jul 14 16:59:12.185519 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.185485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" event={"ID":"36c17792-96db-4787-8f5d-d35545cd93e2","Type":"ContainerDied","Data":"30d152bb350c72996d28c0793e391c7940b2f901f09367f605a3f03d1095e7dc"}
Jul 14 16:59:12.185519 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.185508    2576 scope.go:117] "RemoveContainer" containerID="0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4"
Jul 14 16:59:12.195502 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.195485    2576 scope.go:117] "RemoveContainer" containerID="0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4"
Jul 14 16:59:12.195767 ip-10-0-141-173 kubenswrapper[2576]: E0714 16:59:12.195744    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4\": container with ID starting with 0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4 not found: ID does not exist" containerID="0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4"
Jul 14 16:59:12.195835 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.195777    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4"} err="failed to get container status \"0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4\": rpc error: code = NotFound desc = could not find container \"0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4\": container with ID starting with 0a909ae13bdd40cf1711bf49b2fdb0fbef3815fcd5bbf50828bf3bef3f4f7ed4 not found: ID does not exist"
Jul 14 16:59:12.215850 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.215813    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"]
Jul 14 16:59:12.219155 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.219136    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb"]
Jul 14 16:59:12.308484 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:12.308416    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c17792-96db-4787-8f5d-d35545cd93e2" path="/var/lib/kubelet/pods/36c17792-96db-4787-8f5d-d35545cd93e2/volumes"
Jul 14 16:59:14.964536 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:14.964491    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-5d77ea9b-5d89656f74-rfdpb" podUID="36c17792-96db-4787-8f5d-d35545cd93e2" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.46:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 14 16:59:22.107182 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:22.107150    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"]
Jul 14 16:59:37.127110 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.127065    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w" podUID="053f1251-38de-443e-837c-2a5d1073f279" containerName="main" containerID="cri-o://11cdf7d56c58bca98a3525d06288decd9200cb04ecf223c7666801477be83f4b" gracePeriod=45
Jul 14 16:59:37.310483 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.310455    2576 generic.go:356] "Generic (PLEG): container finished" podID="053f1251-38de-443e-837c-2a5d1073f279" containerID="11cdf7d56c58bca98a3525d06288decd9200cb04ecf223c7666801477be83f4b" exitCode=0
Jul 14 16:59:37.310660 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.310500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w" event={"ID":"053f1251-38de-443e-837c-2a5d1073f279","Type":"ContainerDied","Data":"11cdf7d56c58bca98a3525d06288decd9200cb04ecf223c7666801477be83f4b"}
Jul 14 16:59:37.384712 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.384615    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:59:37.507250 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-model-cache\") pod \"053f1251-38de-443e-837c-2a5d1073f279\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") "
Jul 14 16:59:37.507250 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507251    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053f1251-38de-443e-837c-2a5d1073f279-tls-certs\") pod \"053f1251-38de-443e-837c-2a5d1073f279\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") "
Jul 14 16:59:37.507479 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507270    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-home\") pod \"053f1251-38de-443e-837c-2a5d1073f279\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") "
Jul 14 16:59:37.507479 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507307    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-tmp-dir\") pod \"053f1251-38de-443e-837c-2a5d1073f279\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") "
Jul 14 16:59:37.507479 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507334    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-dshm\") pod \"053f1251-38de-443e-837c-2a5d1073f279\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") "
Jul 14 16:59:37.507479 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507372    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgfdv\" (UniqueName: \"kubernetes.io/projected/053f1251-38de-443e-837c-2a5d1073f279-kube-api-access-vgfdv\") pod \"053f1251-38de-443e-837c-2a5d1073f279\" (UID: \"053f1251-38de-443e-837c-2a5d1073f279\") "
Jul 14 16:59:37.507700 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507518    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-model-cache" (OuterVolumeSpecName: "model-cache") pod "053f1251-38de-443e-837c-2a5d1073f279" (UID: "053f1251-38de-443e-837c-2a5d1073f279"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:59:37.507700 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507650    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-home" (OuterVolumeSpecName: "home") pod "053f1251-38de-443e-837c-2a5d1073f279" (UID: "053f1251-38de-443e-837c-2a5d1073f279"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:59:37.507700 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507660    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-model-cache\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:37.507836 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.507704    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "053f1251-38de-443e-837c-2a5d1073f279" (UID: "053f1251-38de-443e-837c-2a5d1073f279"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:59:37.509576 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.509552    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/053f1251-38de-443e-837c-2a5d1073f279-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "053f1251-38de-443e-837c-2a5d1073f279" (UID: "053f1251-38de-443e-837c-2a5d1073f279"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:59:37.509703 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.509590    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053f1251-38de-443e-837c-2a5d1073f279-kube-api-access-vgfdv" (OuterVolumeSpecName: "kube-api-access-vgfdv") pod "053f1251-38de-443e-837c-2a5d1073f279" (UID: "053f1251-38de-443e-837c-2a5d1073f279"). InnerVolumeSpecName "kube-api-access-vgfdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:59:37.509703 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.509646    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-dshm" (OuterVolumeSpecName: "dshm") pod "053f1251-38de-443e-837c-2a5d1073f279" (UID: "053f1251-38de-443e-837c-2a5d1073f279"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:59:37.608471 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.608440    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053f1251-38de-443e-837c-2a5d1073f279-tls-certs\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:37.608471 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.608465    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-home\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:37.608471 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.608472    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-tmp-dir\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:37.608471 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.608480    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053f1251-38de-443e-837c-2a5d1073f279-dshm\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:37.608732 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:37.608489    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgfdv\" (UniqueName: \"kubernetes.io/projected/053f1251-38de-443e-837c-2a5d1073f279-kube-api-access-vgfdv\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 16:59:38.316210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:38.316183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w" event={"ID":"053f1251-38de-443e-837c-2a5d1073f279","Type":"ContainerDied","Data":"1fdede6d99d8ac50a2b389ce262121a2198df1f8fcae0dc4b76f30a5b3c4eb63"}
Jul 14 16:59:38.316210 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:38.316203    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"
Jul 14 16:59:38.316601 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:38.316227    2576 scope.go:117] "RemoveContainer" containerID="11cdf7d56c58bca98a3525d06288decd9200cb04ecf223c7666801477be83f4b"
Jul 14 16:59:38.343044 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:38.343021    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"]
Jul 14 16:59:38.347383 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:38.347363    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5d77ea9b/e2e-lifecycle-model-5d77ea9b-kserve-58fc89d55f-ff47w"]
Jul 14 16:59:40.306884 ip-10-0-141-173 kubenswrapper[2576]: I0714 16:59:40.306855    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053f1251-38de-443e-837c-2a5d1073f279" path="/var/lib/kubelet/pods/053f1251-38de-443e-837c-2a5d1073f279/volumes"
Jul 14 17:00:00.192826 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.192787    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29734140-6vz2g"]
Jul 14 17:00:00.195180 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.193163    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053f1251-38de-443e-837c-2a5d1073f279" containerName="main"
Jul 14 17:00:00.195180 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.193173    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="053f1251-38de-443e-837c-2a5d1073f279" containerName="main"
Jul 14 17:00:00.195180 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.193194    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c17792-96db-4787-8f5d-d35545cd93e2" containerName="maas-api"
Jul 14 17:00:00.195180 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.193200    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c17792-96db-4787-8f5d-d35545cd93e2" containerName="maas-api"
Jul 14 17:00:00.195180 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.193258    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c17792-96db-4787-8f5d-d35545cd93e2" containerName="maas-api"
Jul 14 17:00:00.195180 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.193266    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="053f1251-38de-443e-837c-2a5d1073f279" containerName="main"
Jul 14 17:00:00.196355 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.196339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g"
Jul 14 17:00:00.227160 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.227129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734140-6vz2g"]
Jul 14 17:00:00.313790 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.313757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf4zx\" (UniqueName: \"kubernetes.io/projected/a4770499-e47b-4d17-83f2-ad51baacad8b-kube-api-access-lf4zx\") pod \"maas-api-key-cleanup-29734140-6vz2g\" (UID: \"a4770499-e47b-4d17-83f2-ad51baacad8b\") " pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g"
Jul 14 17:00:00.414391 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.414359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf4zx\" (UniqueName: \"kubernetes.io/projected/a4770499-e47b-4d17-83f2-ad51baacad8b-kube-api-access-lf4zx\") pod \"maas-api-key-cleanup-29734140-6vz2g\" (UID: \"a4770499-e47b-4d17-83f2-ad51baacad8b\") " pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g"
Jul 14 17:00:00.442880 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.442806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf4zx\" (UniqueName: \"kubernetes.io/projected/a4770499-e47b-4d17-83f2-ad51baacad8b-kube-api-access-lf4zx\") pod \"maas-api-key-cleanup-29734140-6vz2g\" (UID: \"a4770499-e47b-4d17-83f2-ad51baacad8b\") " pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g"
Jul 14 17:00:00.505915 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.505880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g"
Jul 14 17:00:00.648274 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:00.648239    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734140-6vz2g"]
Jul 14 17:00:00.651750 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:00:00.651723    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4770499_e47b_4d17_83f2_ad51baacad8b.slice/crio-96a215dab888e582527519888f1c8f2ff2e30681ad813f06cd0af95f867a4b3f WatchSource:0}: Error finding container 96a215dab888e582527519888f1c8f2ff2e30681ad813f06cd0af95f867a4b3f: Status 404 returned error can't find the container with id 96a215dab888e582527519888f1c8f2ff2e30681ad813f06cd0af95f867a4b3f
Jul 14 17:00:01.425874 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:01.425836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g" event={"ID":"a4770499-e47b-4d17-83f2-ad51baacad8b","Type":"ContainerStarted","Data":"a0828e9db4c249cbc7777f66ad767a306a2c505e43acb89061c64c84934370d0"}
Jul 14 17:00:01.426251 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:01.425890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g" event={"ID":"a4770499-e47b-4d17-83f2-ad51baacad8b","Type":"ContainerStarted","Data":"96a215dab888e582527519888f1c8f2ff2e30681ad813f06cd0af95f867a4b3f"}
Jul 14 17:00:02.431949 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:02.431912    2576 generic.go:356] "Generic (PLEG): container finished" podID="a4770499-e47b-4d17-83f2-ad51baacad8b" containerID="a0828e9db4c249cbc7777f66ad767a306a2c505e43acb89061c64c84934370d0" exitCode=0
Jul 14 17:00:02.432373 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:02.431997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g" event={"ID":"a4770499-e47b-4d17-83f2-ad51baacad8b","Type":"ContainerDied","Data":"a0828e9db4c249cbc7777f66ad767a306a2c505e43acb89061c64c84934370d0"}
Jul 14 17:00:03.578072 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:03.578048    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g"
Jul 14 17:00:03.642112 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:03.642075    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf4zx\" (UniqueName: \"kubernetes.io/projected/a4770499-e47b-4d17-83f2-ad51baacad8b-kube-api-access-lf4zx\") pod \"a4770499-e47b-4d17-83f2-ad51baacad8b\" (UID: \"a4770499-e47b-4d17-83f2-ad51baacad8b\") "
Jul 14 17:00:03.644131 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:03.644097    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4770499-e47b-4d17-83f2-ad51baacad8b-kube-api-access-lf4zx" (OuterVolumeSpecName: "kube-api-access-lf4zx") pod "a4770499-e47b-4d17-83f2-ad51baacad8b" (UID: "a4770499-e47b-4d17-83f2-ad51baacad8b"). InnerVolumeSpecName "kube-api-access-lf4zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:00:03.743482 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:03.743457    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf4zx\" (UniqueName: \"kubernetes.io/projected/a4770499-e47b-4d17-83f2-ad51baacad8b-kube-api-access-lf4zx\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:00:04.450008 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:04.449968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g" event={"ID":"a4770499-e47b-4d17-83f2-ad51baacad8b","Type":"ContainerDied","Data":"96a215dab888e582527519888f1c8f2ff2e30681ad813f06cd0af95f867a4b3f"}
Jul 14 17:00:04.450008 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:04.449987    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734140-6vz2g"
Jul 14 17:00:04.450214 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:00:04.450040    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96a215dab888e582527519888f1c8f2ff2e30681ad813f06cd0af95f867a4b3f"
Jul 14 17:01:12.490705 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.490664    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"]
Jul 14 17:01:12.491253 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.491234    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4770499-e47b-4d17-83f2-ad51baacad8b" containerName="cleanup"
Jul 14 17:01:12.491329 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.491257    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4770499-e47b-4d17-83f2-ad51baacad8b" containerName="cleanup"
Jul 14 17:01:12.491386 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.491376    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4770499-e47b-4d17-83f2-ad51baacad8b" containerName="cleanup"
Jul 14 17:01:12.494513 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.494493    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.501018 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.500990    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-1c66bf-serving-cert\""
Jul 14 17:01:12.524963 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.524934    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"]
Jul 14 17:01:12.668863 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.668834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.669031 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.668870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqlp6\" (UniqueName: \"kubernetes.io/projected/a4a8701a-5393-4621-8dda-f16a28c729d3-kube-api-access-jqlp6\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.669031 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.668970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a8701a-5393-4621-8dda-f16a28c729d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.769739 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.769646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a8701a-5393-4621-8dda-f16a28c729d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.769739 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.769727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.769945 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.769753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqlp6\" (UniqueName: \"kubernetes.io/projected/a4a8701a-5393-4621-8dda-f16a28c729d3-kube-api-access-jqlp6\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.769945 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:01:12.769860    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-1c66bf-serving-cert: secret "maas-api-e2e-inf-a-1c66bf-serving-cert" not found
Jul 14 17:01:12.770052 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:01:12.769953    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls podName:a4a8701a-5393-4621-8dda-f16a28c729d3 nodeName:}" failed. No retries permitted until 2026-07-14 17:01:13.269928352 +0000 UTC m=+1862.399912547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls") pod "maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z" (UID: "a4a8701a-5393-4621-8dda-f16a28c729d3") : secret "maas-api-e2e-inf-a-1c66bf-serving-cert" not found
Jul 14 17:01:12.770424 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.770403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a8701a-5393-4621-8dda-f16a28c729d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:12.793543 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:12.793510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqlp6\" (UniqueName: \"kubernetes.io/projected/a4a8701a-5393-4621-8dda-f16a28c729d3-kube-api-access-jqlp6\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:13.273964 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:13.273925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:13.276317 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:13.276283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") " pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:13.409953 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:13.409917    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:13.553206 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:01:13.553172    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a8701a_5393_4621_8dda_f16a28c729d3.slice/crio-e2e45c8d10b84cb556d4cbca2fd0b31c1f7115587d17c0a7d39db516b9bdfd43 WatchSource:0}: Error finding container e2e45c8d10b84cb556d4cbca2fd0b31c1f7115587d17c0a7d39db516b9bdfd43: Status 404 returned error can't find the container with id e2e45c8d10b84cb556d4cbca2fd0b31c1f7115587d17c0a7d39db516b9bdfd43
Jul 14 17:01:13.554792 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:13.554685    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"]
Jul 14 17:01:13.555143 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:13.555126    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 17:01:13.781378 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:13.781341    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z" event={"ID":"a4a8701a-5393-4621-8dda-f16a28c729d3","Type":"ContainerStarted","Data":"e2e45c8d10b84cb556d4cbca2fd0b31c1f7115587d17c0a7d39db516b9bdfd43"}
Jul 14 17:01:14.787186 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:14.787149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z" event={"ID":"a4a8701a-5393-4621-8dda-f16a28c729d3","Type":"ContainerStarted","Data":"558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a"}
Jul 14 17:01:14.787551 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:14.787254    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:14.838955 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:14.838900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z" podStartSLOduration=2.324012387 podStartE2EDuration="2.83888418s" totalImagesPullingTime="514.871793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:01:14.835748147 +0000 UTC m=+1863.965732369" watchObservedRunningTime="2026-07-14 17:01:14.83888418 +0000 UTC m=+1863.968868379"
Jul 14 17:01:20.798552 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:20.798519    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:01:21.243876 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.243845    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"]
Jul 14 17:01:21.247790 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.247772    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.251495 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.251474    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-3a7c08-serving-cert\""
Jul 14 17:01:21.323905 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.323879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"]
Jul 14 17:01:21.336988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.336955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/248b62cb-6f8e-4280-9549-e17506860656-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.337113 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.336999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnlnv\" (UniqueName: \"kubernetes.io/projected/248b62cb-6f8e-4280-9549-e17506860656-kube-api-access-wnlnv\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.337150 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.337109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.437981 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.437945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.438146 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.438010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/248b62cb-6f8e-4280-9549-e17506860656-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.438146 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.438036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnlnv\" (UniqueName: \"kubernetes.io/projected/248b62cb-6f8e-4280-9549-e17506860656-kube-api-access-wnlnv\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.438146 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:01:21.438127    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-3a7c08-serving-cert: secret "maas-api-e2e-inf-b-3a7c08-serving-cert" not found
Jul 14 17:01:21.438274 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:01:21.438208    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls podName:248b62cb-6f8e-4280-9549-e17506860656 nodeName:}" failed. No retries permitted until 2026-07-14 17:01:21.938186485 +0000 UTC m=+1871.068170685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls") pod "maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd" (UID: "248b62cb-6f8e-4280-9549-e17506860656") : secret "maas-api-e2e-inf-b-3a7c08-serving-cert" not found
Jul 14 17:01:21.438677 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.438659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/248b62cb-6f8e-4280-9549-e17506860656-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.457159 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.457133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnlnv\" (UniqueName: \"kubernetes.io/projected/248b62cb-6f8e-4280-9549-e17506860656-kube-api-access-wnlnv\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.942946 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.942907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:21.945358 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:21.945336    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls\") pod \"maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") " pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:22.157769 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:22.157737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:22.297973 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:22.297946    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"]
Jul 14 17:01:22.299605 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:01:22.299580    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248b62cb_6f8e_4280_9549_e17506860656.slice/crio-3bc3a945df9520070f9d0152cff7939fc9f53f0ce88015fcfb56fee200012e8b WatchSource:0}: Error finding container 3bc3a945df9520070f9d0152cff7939fc9f53f0ce88015fcfb56fee200012e8b: Status 404 returned error can't find the container with id 3bc3a945df9520070f9d0152cff7939fc9f53f0ce88015fcfb56fee200012e8b
Jul 14 17:01:22.828727 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:22.828687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd" event={"ID":"248b62cb-6f8e-4280-9549-e17506860656","Type":"ContainerStarted","Data":"3bc3a945df9520070f9d0152cff7939fc9f53f0ce88015fcfb56fee200012e8b"}
Jul 14 17:01:23.835557 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:23.835519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd" event={"ID":"248b62cb-6f8e-4280-9549-e17506860656","Type":"ContainerStarted","Data":"82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c"}
Jul 14 17:01:23.836038 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:23.835655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:23.865260 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:23.865215    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd" podStartSLOduration=2.109277819 podStartE2EDuration="2.865200574s" totalImagesPullingTime="755.922755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:01:23.864938918 +0000 UTC m=+1872.994923118" watchObservedRunningTime="2026-07-14 17:01:23.865200574 +0000 UTC m=+1872.995184774"
Jul 14 17:01:29.845923 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:29.845888    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:01:46.423543 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.423511    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"]
Jul 14 17:01:46.427208 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.427189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.436619 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.436596    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1c66bf\"/\"kube-root-ca.crt\""
Jul 14 17:01:46.437795 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.437774    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1c66bf\"/\"test-model-1c66bf-kserve-self-signed-certs\""
Jul 14 17:01:46.437888 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.437805    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1c66bf\"/\"openshift-service-ca.crt\""
Jul 14 17:01:46.437888 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.437816    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1c66bf\"/\"default-dockercfg-np2lk\""
Jul 14 17:01:46.453007 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.452975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"]
Jul 14 17:01:46.564997 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.564960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/390c8788-4e66-4eb0-94ad-303c269d1961-tls-certs\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.564997 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.564998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-dshm\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.565185 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.565019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/390c8788-4e66-4eb0-94ad-303c269d1961-kube-api-access-qfsjz\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.565185 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.565096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-home\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.565185 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.565128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-model-cache\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.565185 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.565163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-tmp-dir\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.666643 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.666595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/390c8788-4e66-4eb0-94ad-303c269d1961-tls-certs\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.666816 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.666667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-dshm\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.666816 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.666699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/390c8788-4e66-4eb0-94ad-303c269d1961-kube-api-access-qfsjz\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.666816 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.666725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-home\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.666967 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.666855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-model-cache\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.666967 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.666911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-tmp-dir\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.667191 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.667172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-home\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.667258 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.667226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-model-cache\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.667295 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.667263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-tmp-dir\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.668899 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.668878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-dshm\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.669146 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.669129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/390c8788-4e66-4eb0-94ad-303c269d1961-tls-certs\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.684539 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.684477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/390c8788-4e66-4eb0-94ad-303c269d1961-kube-api-access-qfsjz\") pod \"test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") " pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.736986 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.736951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:46.877701 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.877677    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"]
Jul 14 17:01:46.879667 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:01:46.879641    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod390c8788_4e66_4eb0_94ad_303c269d1961.slice/crio-dac32fb678b475e3e5d6991964d7854a2a82ebc4c8f049208c5bba83431272e6 WatchSource:0}: Error finding container dac32fb678b475e3e5d6991964d7854a2a82ebc4c8f049208c5bba83431272e6: Status 404 returned error can't find the container with id dac32fb678b475e3e5d6991964d7854a2a82ebc4c8f049208c5bba83431272e6
Jul 14 17:01:46.947070 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.947037    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls" event={"ID":"390c8788-4e66-4eb0-94ad-303c269d1961","Type":"ContainerStarted","Data":"7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50"}
Jul 14 17:01:46.947166 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:46.947087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls" event={"ID":"390c8788-4e66-4eb0-94ad-303c269d1961","Type":"ContainerStarted","Data":"dac32fb678b475e3e5d6991964d7854a2a82ebc4c8f049208c5bba83431272e6"}
Jul 14 17:01:56.737459 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:56.737419    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:56.737957 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:56.737477    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:56.750108 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:56.750081    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:01:56.781190 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:56.781138    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls" podStartSLOduration=10.78112324 podStartE2EDuration="10.78112324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:01:46.977413783 +0000 UTC m=+1896.107397983" watchObservedRunningTime="2026-07-14 17:01:56.78112324 +0000 UTC m=+1905.911107440"
Jul 14 17:01:57.008249 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:01:57.008170    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:02:45.467058 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:45.467014    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"]
Jul 14 17:02:47.893467 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:47.893430    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"]
Jul 14 17:02:47.893928 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:47.893715    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z" podUID="a4a8701a-5393-4621-8dda-f16a28c729d3" containerName="maas-api" containerID="cri-o://558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a" gracePeriod=30
Jul 14 17:02:48.139066 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.139037    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:02:48.229468 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.229374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqlp6\" (UniqueName: \"kubernetes.io/projected/a4a8701a-5393-4621-8dda-f16a28c729d3-kube-api-access-jqlp6\") pod \"a4a8701a-5393-4621-8dda-f16a28c729d3\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") "
Jul 14 17:02:48.229664 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.229470    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls\") pod \"a4a8701a-5393-4621-8dda-f16a28c729d3\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") "
Jul 14 17:02:48.229664 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.229532    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a8701a-5393-4621-8dda-f16a28c729d3-openshift-service-ca\") pod \"a4a8701a-5393-4621-8dda-f16a28c729d3\" (UID: \"a4a8701a-5393-4621-8dda-f16a28c729d3\") "
Jul 14 17:02:48.230024 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.229991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4a8701a-5393-4621-8dda-f16a28c729d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a4a8701a-5393-4621-8dda-f16a28c729d3" (UID: "a4a8701a-5393-4621-8dda-f16a28c729d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:02:48.231735 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.231702    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a4a8701a-5393-4621-8dda-f16a28c729d3" (UID: "a4a8701a-5393-4621-8dda-f16a28c729d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:02:48.231845 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.231802    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a8701a-5393-4621-8dda-f16a28c729d3-kube-api-access-jqlp6" (OuterVolumeSpecName: "kube-api-access-jqlp6") pod "a4a8701a-5393-4621-8dda-f16a28c729d3" (UID: "a4a8701a-5393-4621-8dda-f16a28c729d3"). InnerVolumeSpecName "kube-api-access-jqlp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:02:48.254278 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.254250    2576 generic.go:356] "Generic (PLEG): container finished" podID="a4a8701a-5393-4621-8dda-f16a28c729d3" containerID="558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a" exitCode=0
Jul 14 17:02:48.254385 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.254288    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"
Jul 14 17:02:48.254385 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.254328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z" event={"ID":"a4a8701a-5393-4621-8dda-f16a28c729d3","Type":"ContainerDied","Data":"558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a"}
Jul 14 17:02:48.254385 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.254378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z" event={"ID":"a4a8701a-5393-4621-8dda-f16a28c729d3","Type":"ContainerDied","Data":"e2e45c8d10b84cb556d4cbca2fd0b31c1f7115587d17c0a7d39db516b9bdfd43"}
Jul 14 17:02:48.254529 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.254400    2576 scope.go:117] "RemoveContainer" containerID="558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a"
Jul 14 17:02:48.263753 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.263739    2576 scope.go:117] "RemoveContainer" containerID="558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a"
Jul 14 17:02:48.264004 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:02:48.263989    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a\": container with ID starting with 558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a not found: ID does not exist" containerID="558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a"
Jul 14 17:02:48.264048 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.264012    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a"} err="failed to get container status \"558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a\": rpc error: code = NotFound desc = could not find container \"558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a\": container with ID starting with 558094f5db2f2f846ba00f91b6a3765642ce6555da074a9009bdf0a71d809d1a not found: ID does not exist"
Jul 14 17:02:48.280318 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.280286    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"]
Jul 14 17:02:48.289410 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.289390    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1c66bf-75985b4bd4-mk79z"]
Jul 14 17:02:48.306420 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.306393    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a8701a-5393-4621-8dda-f16a28c729d3" path="/var/lib/kubelet/pods/a4a8701a-5393-4621-8dda-f16a28c729d3/volumes"
Jul 14 17:02:48.331016 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.330995    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a8701a-5393-4621-8dda-f16a28c729d3-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:02:48.331016 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.331016    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqlp6\" (UniqueName: \"kubernetes.io/projected/a4a8701a-5393-4621-8dda-f16a28c729d3-kube-api-access-jqlp6\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:02:48.331186 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:02:48.331027    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4a8701a-5393-4621-8dda-f16a28c729d3-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:00.487365 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.487293    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls" podUID="390c8788-4e66-4eb0-94ad-303c269d1961" containerName="main" containerID="cri-o://7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50" gracePeriod=45
Jul 14 17:03:00.749028 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.748972    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:03:00.840373 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-home\") pod \"390c8788-4e66-4eb0-94ad-303c269d1961\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") "
Jul 14 17:03:00.840572 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840389    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-dshm\") pod \"390c8788-4e66-4eb0-94ad-303c269d1961\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") "
Jul 14 17:03:00.840572 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-model-cache\") pod \"390c8788-4e66-4eb0-94ad-303c269d1961\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") "
Jul 14 17:03:00.840572 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840455    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/390c8788-4e66-4eb0-94ad-303c269d1961-tls-certs\") pod \"390c8788-4e66-4eb0-94ad-303c269d1961\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") "
Jul 14 17:03:00.840572 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840499    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-tmp-dir\") pod \"390c8788-4e66-4eb0-94ad-303c269d1961\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") "
Jul 14 17:03:00.840572 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840564    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/390c8788-4e66-4eb0-94ad-303c269d1961-kube-api-access-qfsjz\") pod \"390c8788-4e66-4eb0-94ad-303c269d1961\" (UID: \"390c8788-4e66-4eb0-94ad-303c269d1961\") "
Jul 14 17:03:00.840859 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840700    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-home" (OuterVolumeSpecName: "home") pod "390c8788-4e66-4eb0-94ad-303c269d1961" (UID: "390c8788-4e66-4eb0-94ad-303c269d1961"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:00.840859 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-model-cache" (OuterVolumeSpecName: "model-cache") pod "390c8788-4e66-4eb0-94ad-303c269d1961" (UID: "390c8788-4e66-4eb0-94ad-303c269d1961"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:00.840968 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840877    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-home\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:00.840968 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840924    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-model-cache\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:00.841130 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.840959    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "390c8788-4e66-4eb0-94ad-303c269d1961" (UID: "390c8788-4e66-4eb0-94ad-303c269d1961"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:00.842748 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.842724    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-dshm" (OuterVolumeSpecName: "dshm") pod "390c8788-4e66-4eb0-94ad-303c269d1961" (UID: "390c8788-4e66-4eb0-94ad-303c269d1961"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:00.842846 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.842782    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/390c8788-4e66-4eb0-94ad-303c269d1961-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "390c8788-4e66-4eb0-94ad-303c269d1961" (UID: "390c8788-4e66-4eb0-94ad-303c269d1961"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:03:00.842901 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.842885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/390c8788-4e66-4eb0-94ad-303c269d1961-kube-api-access-qfsjz" (OuterVolumeSpecName: "kube-api-access-qfsjz") pod "390c8788-4e66-4eb0-94ad-303c269d1961" (UID: "390c8788-4e66-4eb0-94ad-303c269d1961"). InnerVolumeSpecName "kube-api-access-qfsjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:03:00.941908 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.941872    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-dshm\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:00.941908 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.941902    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/390c8788-4e66-4eb0-94ad-303c269d1961-tls-certs\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:00.941908 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.941913    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/390c8788-4e66-4eb0-94ad-303c269d1961-tmp-dir\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:00.942151 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:00.941921    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/390c8788-4e66-4eb0-94ad-303c269d1961-kube-api-access-qfsjz\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:01.317641 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.317588    2576 generic.go:356] "Generic (PLEG): container finished" podID="390c8788-4e66-4eb0-94ad-303c269d1961" containerID="7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50" exitCode=0
Jul 14 17:03:01.317799 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.317662    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"
Jul 14 17:03:01.317799 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.317679    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls" event={"ID":"390c8788-4e66-4eb0-94ad-303c269d1961","Type":"ContainerDied","Data":"7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50"}
Jul 14 17:03:01.317799 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.317724    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls" event={"ID":"390c8788-4e66-4eb0-94ad-303c269d1961","Type":"ContainerDied","Data":"dac32fb678b475e3e5d6991964d7854a2a82ebc4c8f049208c5bba83431272e6"}
Jul 14 17:03:01.317799 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.317747    2576 scope.go:117] "RemoveContainer" containerID="7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50"
Jul 14 17:03:01.328527 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.328423    2576 scope.go:117] "RemoveContainer" containerID="7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50"
Jul 14 17:03:01.328780 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:03:01.328755    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50\": container with ID starting with 7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50 not found: ID does not exist" containerID="7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50"
Jul 14 17:03:01.328862 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.328797    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50"} err="failed to get container status \"7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50\": rpc error: code = NotFound desc = could not find container \"7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50\": container with ID starting with 7b57f0ca281c3a39f35876307c29a49e1feb78cac919c0330d4e1b284d8e8e50 not found: ID does not exist"
Jul 14 17:03:01.345933 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.345908    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"]
Jul 14 17:03:01.353429 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:01.353407    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1c66bf/test-model-1c66bf-kserve-7c8f9d6bf7-ns6ls"]
Jul 14 17:03:02.306507 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:02.306472    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="390c8788-4e66-4eb0-94ad-303c269d1961" path="/var/lib/kubelet/pods/390c8788-4e66-4eb0-94ad-303c269d1961/volumes"
Jul 14 17:03:32.915833 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:32.915798    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"]
Jul 14 17:03:32.916324 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:32.915994    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd" podUID="248b62cb-6f8e-4280-9549-e17506860656" containerName="maas-api" containerID="cri-o://82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c" gracePeriod=30
Jul 14 17:03:33.164824 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.164798    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:03:33.219207 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.219130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/248b62cb-6f8e-4280-9549-e17506860656-openshift-service-ca\") pod \"248b62cb-6f8e-4280-9549-e17506860656\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") "
Jul 14 17:03:33.219353 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.219223    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnlnv\" (UniqueName: \"kubernetes.io/projected/248b62cb-6f8e-4280-9549-e17506860656-kube-api-access-wnlnv\") pod \"248b62cb-6f8e-4280-9549-e17506860656\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") "
Jul 14 17:03:33.219353 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.219252    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls\") pod \"248b62cb-6f8e-4280-9549-e17506860656\" (UID: \"248b62cb-6f8e-4280-9549-e17506860656\") "
Jul 14 17:03:33.219552 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.219522    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/248b62cb-6f8e-4280-9549-e17506860656-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "248b62cb-6f8e-4280-9549-e17506860656" (UID: "248b62cb-6f8e-4280-9549-e17506860656"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:03:33.221243 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.221212    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/248b62cb-6f8e-4280-9549-e17506860656-kube-api-access-wnlnv" (OuterVolumeSpecName: "kube-api-access-wnlnv") pod "248b62cb-6f8e-4280-9549-e17506860656" (UID: "248b62cb-6f8e-4280-9549-e17506860656"). InnerVolumeSpecName "kube-api-access-wnlnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:03:33.221376 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.221360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "248b62cb-6f8e-4280-9549-e17506860656" (UID: "248b62cb-6f8e-4280-9549-e17506860656"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:03:33.319986 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.319942    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnlnv\" (UniqueName: \"kubernetes.io/projected/248b62cb-6f8e-4280-9549-e17506860656-kube-api-access-wnlnv\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:33.319986 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.319977    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/248b62cb-6f8e-4280-9549-e17506860656-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:33.319986 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.319986    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/248b62cb-6f8e-4280-9549-e17506860656-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:03:33.476437 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.476342    2576 generic.go:356] "Generic (PLEG): container finished" podID="248b62cb-6f8e-4280-9549-e17506860656" containerID="82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c" exitCode=0
Jul 14 17:03:33.476437 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.476390    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"
Jul 14 17:03:33.476437 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.476409    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd" event={"ID":"248b62cb-6f8e-4280-9549-e17506860656","Type":"ContainerDied","Data":"82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c"}
Jul 14 17:03:33.476761 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.476457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd" event={"ID":"248b62cb-6f8e-4280-9549-e17506860656","Type":"ContainerDied","Data":"3bc3a945df9520070f9d0152cff7939fc9f53f0ce88015fcfb56fee200012e8b"}
Jul 14 17:03:33.476761 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.476482    2576 scope.go:117] "RemoveContainer" containerID="82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c"
Jul 14 17:03:33.485562 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.485544    2576 scope.go:117] "RemoveContainer" containerID="82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c"
Jul 14 17:03:33.485856 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:03:33.485837    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c\": container with ID starting with 82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c not found: ID does not exist" containerID="82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c"
Jul 14 17:03:33.485924 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.485864    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c"} err="failed to get container status \"82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c\": rpc error: code = NotFound desc = could not find container \"82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c\": container with ID starting with 82e4dc41482ef6319531a3d33833f8c26e93aaf56512ea911a36b558b0d3f61c not found: ID does not exist"
Jul 14 17:03:33.508521 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.508490    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"]
Jul 14 17:03:33.513678 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:33.513656    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3a7c08-846858b6c-v9pbd"]
Jul 14 17:03:34.306579 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:34.306546    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="248b62cb-6f8e-4280-9549-e17506860656" path="/var/lib/kubelet/pods/248b62cb-6f8e-4280-9549-e17506860656/volumes"
Jul 14 17:03:44.102104 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102067    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"]
Jul 14 17:03:44.102524 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102459    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="390c8788-4e66-4eb0-94ad-303c269d1961" containerName="main"
Jul 14 17:03:44.102524 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102470    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="390c8788-4e66-4eb0-94ad-303c269d1961" containerName="main"
Jul 14 17:03:44.102524 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102504    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a8701a-5393-4621-8dda-f16a28c729d3" containerName="maas-api"
Jul 14 17:03:44.102524 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102509    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a8701a-5393-4621-8dda-f16a28c729d3" containerName="maas-api"
Jul 14 17:03:44.102524 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102517    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248b62cb-6f8e-4280-9549-e17506860656" containerName="maas-api"
Jul 14 17:03:44.102524 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102523    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="248b62cb-6f8e-4280-9549-e17506860656" containerName="maas-api"
Jul 14 17:03:44.102750 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102578    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="390c8788-4e66-4eb0-94ad-303c269d1961" containerName="main"
Jul 14 17:03:44.102750 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102589    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a8701a-5393-4621-8dda-f16a28c729d3" containerName="maas-api"
Jul 14 17:03:44.102750 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.102594    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="248b62cb-6f8e-4280-9549-e17506860656" containerName="maas-api"
Jul 14 17:03:44.105866 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.105848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.110990 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.110968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-417196-serving-cert\""
Jul 14 17:03:44.121140 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.121114    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"]
Jul 14 17:03:44.209387 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.209354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhqth\" (UniqueName: \"kubernetes.io/projected/17e24c4f-3eab-46d3-8db3-3481366137ee-kube-api-access-fhqth\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.209545 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.209412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17e24c4f-3eab-46d3-8db3-3481366137ee-openshift-service-ca\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.209545 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.209490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17e24c4f-3eab-46d3-8db3-3481366137ee-maas-api-tls\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.309927 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.309893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17e24c4f-3eab-46d3-8db3-3481366137ee-openshift-service-ca\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.310096 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.309943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17e24c4f-3eab-46d3-8db3-3481366137ee-maas-api-tls\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.310096 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.309992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhqth\" (UniqueName: \"kubernetes.io/projected/17e24c4f-3eab-46d3-8db3-3481366137ee-kube-api-access-fhqth\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.310492 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.310472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17e24c4f-3eab-46d3-8db3-3481366137ee-openshift-service-ca\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.312425 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.312403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17e24c4f-3eab-46d3-8db3-3481366137ee-maas-api-tls\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.330691 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.330657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhqth\" (UniqueName: \"kubernetes.io/projected/17e24c4f-3eab-46d3-8db3-3481366137ee-kube-api-access-fhqth\") pod \"maas-api-e2e-api-a-417196-76bd64c49f-tlq9j\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") " pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.415672 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.415592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:44.561043 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:44.561014    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"]
Jul 14 17:03:44.562942 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:03:44.562910    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e24c4f_3eab_46d3_8db3_3481366137ee.slice/crio-4a306056f1f2c239969b290bd8a8919bee9305c69b67eb8710cdfe6c4dc6bba8 WatchSource:0}: Error finding container 4a306056f1f2c239969b290bd8a8919bee9305c69b67eb8710cdfe6c4dc6bba8: Status 404 returned error can't find the container with id 4a306056f1f2c239969b290bd8a8919bee9305c69b67eb8710cdfe6c4dc6bba8
Jul 14 17:03:45.539652 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:45.539588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j" event={"ID":"17e24c4f-3eab-46d3-8db3-3481366137ee","Type":"ContainerStarted","Data":"57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60"}
Jul 14 17:03:45.540059 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:45.539675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j" event={"ID":"17e24c4f-3eab-46d3-8db3-3481366137ee","Type":"ContainerStarted","Data":"4a306056f1f2c239969b290bd8a8919bee9305c69b67eb8710cdfe6c4dc6bba8"}
Jul 14 17:03:45.540059 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:45.539720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:45.568422 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:45.568375    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j" podStartSLOduration=1.144911364 podStartE2EDuration="1.568359586s" totalImagesPullingTime="423.448222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:03:45.568311876 +0000 UTC m=+2014.698296075" watchObservedRunningTime="2026-07-14 17:03:45.568359586 +0000 UTC m=+2014.698343786"
Jul 14 17:03:51.550271 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:51.550240    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:03:53.269912 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.269884    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"]
Jul 14 17:03:53.273389 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.273365    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.277888 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.277871    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-845e65-serving-cert\""
Jul 14 17:03:53.343010 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.342977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"]
Jul 14 17:03:53.391994 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.391961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3437e2-12c5-475e-a421-1354dd34b356-openshift-service-ca\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.391994 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.391996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr8l4\" (UniqueName: \"kubernetes.io/projected/1e3437e2-12c5-475e-a421-1354dd34b356-kube-api-access-hr8l4\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.392188 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.392095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3437e2-12c5-475e-a421-1354dd34b356-maas-api-tls\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.493412 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.493377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3437e2-12c5-475e-a421-1354dd34b356-maas-api-tls\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.493590 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.493434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3437e2-12c5-475e-a421-1354dd34b356-openshift-service-ca\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.493590 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.493452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr8l4\" (UniqueName: \"kubernetes.io/projected/1e3437e2-12c5-475e-a421-1354dd34b356-kube-api-access-hr8l4\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.494137 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.494110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3437e2-12c5-475e-a421-1354dd34b356-openshift-service-ca\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.495738 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.495712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3437e2-12c5-475e-a421-1354dd34b356-maas-api-tls\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.527016 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.526946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr8l4\" (UniqueName: \"kubernetes.io/projected/1e3437e2-12c5-475e-a421-1354dd34b356-kube-api-access-hr8l4\") pod \"maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") " pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.584773 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.584740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:53.764197 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:53.764161    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"]
Jul 14 17:03:53.770164 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:03:53.770129    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3437e2_12c5_475e_a421_1354dd34b356.slice/crio-bcd2ddd293f4e4b78a35022dc5168b99315c602a370fbb04468a889b8811954f WatchSource:0}: Error finding container bcd2ddd293f4e4b78a35022dc5168b99315c602a370fbb04468a889b8811954f: Status 404 returned error can't find the container with id bcd2ddd293f4e4b78a35022dc5168b99315c602a370fbb04468a889b8811954f
Jul 14 17:03:54.585200 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:54.585164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6" event={"ID":"1e3437e2-12c5-475e-a421-1354dd34b356","Type":"ContainerStarted","Data":"2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826"}
Jul 14 17:03:54.585574 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:54.585217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6" event={"ID":"1e3437e2-12c5-475e-a421-1354dd34b356","Type":"ContainerStarted","Data":"bcd2ddd293f4e4b78a35022dc5168b99315c602a370fbb04468a889b8811954f"}
Jul 14 17:03:54.585574 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:54.585260    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:03:54.623432 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:03:54.623387    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6" podStartSLOduration=1.158360995 podStartE2EDuration="1.623371681s" totalImagesPullingTime="465.010686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:03:54.620306853 +0000 UTC m=+2023.750291065" watchObservedRunningTime="2026-07-14 17:03:54.623371681 +0000 UTC m=+2023.753355899"
Jul 14 17:04:00.596671 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:00.596636    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:04:07.143283 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.143247    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"]
Jul 14 17:04:07.143669 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.143468    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j" podUID="17e24c4f-3eab-46d3-8db3-3481366137ee" containerName="maas-api" containerID="cri-o://57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60" gracePeriod=30
Jul 14 17:04:07.393188 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.393161    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:04:07.524941 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.524909    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17e24c4f-3eab-46d3-8db3-3481366137ee-maas-api-tls\") pod \"17e24c4f-3eab-46d3-8db3-3481366137ee\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") "
Jul 14 17:04:07.525144 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.524976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhqth\" (UniqueName: \"kubernetes.io/projected/17e24c4f-3eab-46d3-8db3-3481366137ee-kube-api-access-fhqth\") pod \"17e24c4f-3eab-46d3-8db3-3481366137ee\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") "
Jul 14 17:04:07.525144 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.525004    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17e24c4f-3eab-46d3-8db3-3481366137ee-openshift-service-ca\") pod \"17e24c4f-3eab-46d3-8db3-3481366137ee\" (UID: \"17e24c4f-3eab-46d3-8db3-3481366137ee\") "
Jul 14 17:04:07.525398 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.525372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e24c4f-3eab-46d3-8db3-3481366137ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17e24c4f-3eab-46d3-8db3-3481366137ee" (UID: "17e24c4f-3eab-46d3-8db3-3481366137ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:04:07.527047 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.527030    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e24c4f-3eab-46d3-8db3-3481366137ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17e24c4f-3eab-46d3-8db3-3481366137ee" (UID: "17e24c4f-3eab-46d3-8db3-3481366137ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:04:07.527131 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.527109    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e24c4f-3eab-46d3-8db3-3481366137ee-kube-api-access-fhqth" (OuterVolumeSpecName: "kube-api-access-fhqth") pod "17e24c4f-3eab-46d3-8db3-3481366137ee" (UID: "17e24c4f-3eab-46d3-8db3-3481366137ee"). InnerVolumeSpecName "kube-api-access-fhqth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:04:07.626194 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.626159    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17e24c4f-3eab-46d3-8db3-3481366137ee-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:04:07.626194 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.626189    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhqth\" (UniqueName: \"kubernetes.io/projected/17e24c4f-3eab-46d3-8db3-3481366137ee-kube-api-access-fhqth\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:04:07.626194 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.626198    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17e24c4f-3eab-46d3-8db3-3481366137ee-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:04:07.649371 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.649325    2576 generic.go:356] "Generic (PLEG): container finished" podID="17e24c4f-3eab-46d3-8db3-3481366137ee" containerID="57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60" exitCode=0
Jul 14 17:04:07.649529 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.649372    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"
Jul 14 17:04:07.649529 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.649403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j" event={"ID":"17e24c4f-3eab-46d3-8db3-3481366137ee","Type":"ContainerDied","Data":"57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60"}
Jul 14 17:04:07.649529 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.649457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j" event={"ID":"17e24c4f-3eab-46d3-8db3-3481366137ee","Type":"ContainerDied","Data":"4a306056f1f2c239969b290bd8a8919bee9305c69b67eb8710cdfe6c4dc6bba8"}
Jul 14 17:04:07.649529 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.649482    2576 scope.go:117] "RemoveContainer" containerID="57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60"
Jul 14 17:04:07.661706 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.661686    2576 scope.go:117] "RemoveContainer" containerID="57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60"
Jul 14 17:04:07.662127 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:04:07.662106    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60\": container with ID starting with 57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60 not found: ID does not exist" containerID="57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60"
Jul 14 17:04:07.662177 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.662140    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60"} err="failed to get container status \"57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60\": rpc error: code = NotFound desc = could not find container \"57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60\": container with ID starting with 57270df2c41b305457b5c35ebb7c3ff929f53c08f0663555297fb6eed96d0e60 not found: ID does not exist"
Jul 14 17:04:07.678254 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.678231    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"]
Jul 14 17:04:07.686290 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:07.686271    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-417196-76bd64c49f-tlq9j"]
Jul 14 17:04:08.307224 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:08.307187    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e24c4f-3eab-46d3-8db3-3481366137ee" path="/var/lib/kubelet/pods/17e24c4f-3eab-46d3-8db3-3481366137ee/volumes"
Jul 14 17:04:16.053641 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.053595    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"]
Jul 14 17:04:16.054067 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.053817    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6" podUID="1e3437e2-12c5-475e-a421-1354dd34b356" containerName="maas-api" containerID="cri-o://2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826" gracePeriod=30
Jul 14 17:04:16.301363 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.301339    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:04:16.401456 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.401367    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr8l4\" (UniqueName: \"kubernetes.io/projected/1e3437e2-12c5-475e-a421-1354dd34b356-kube-api-access-hr8l4\") pod \"1e3437e2-12c5-475e-a421-1354dd34b356\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") "
Jul 14 17:04:16.401613 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.401491    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3437e2-12c5-475e-a421-1354dd34b356-openshift-service-ca\") pod \"1e3437e2-12c5-475e-a421-1354dd34b356\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") "
Jul 14 17:04:16.401613 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.401509    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3437e2-12c5-475e-a421-1354dd34b356-maas-api-tls\") pod \"1e3437e2-12c5-475e-a421-1354dd34b356\" (UID: \"1e3437e2-12c5-475e-a421-1354dd34b356\") "
Jul 14 17:04:16.401930 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.401882    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3437e2-12c5-475e-a421-1354dd34b356-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e3437e2-12c5-475e-a421-1354dd34b356" (UID: "1e3437e2-12c5-475e-a421-1354dd34b356"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:04:16.403500 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.403468    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3437e2-12c5-475e-a421-1354dd34b356-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e3437e2-12c5-475e-a421-1354dd34b356" (UID: "1e3437e2-12c5-475e-a421-1354dd34b356"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:04:16.403500 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.403470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3437e2-12c5-475e-a421-1354dd34b356-kube-api-access-hr8l4" (OuterVolumeSpecName: "kube-api-access-hr8l4") pod "1e3437e2-12c5-475e-a421-1354dd34b356" (UID: "1e3437e2-12c5-475e-a421-1354dd34b356"). InnerVolumeSpecName "kube-api-access-hr8l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:04:16.503018 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.502982    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr8l4\" (UniqueName: \"kubernetes.io/projected/1e3437e2-12c5-475e-a421-1354dd34b356-kube-api-access-hr8l4\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:04:16.503018 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.503012    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3437e2-12c5-475e-a421-1354dd34b356-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:04:16.503018 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.503023    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3437e2-12c5-475e-a421-1354dd34b356-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:04:16.694539 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.694451    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e3437e2-12c5-475e-a421-1354dd34b356" containerID="2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826" exitCode=0
Jul 14 17:04:16.694539 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.694492    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"
Jul 14 17:04:16.694539 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.694532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6" event={"ID":"1e3437e2-12c5-475e-a421-1354dd34b356","Type":"ContainerDied","Data":"2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826"}
Jul 14 17:04:16.694816 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.694585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6" event={"ID":"1e3437e2-12c5-475e-a421-1354dd34b356","Type":"ContainerDied","Data":"bcd2ddd293f4e4b78a35022dc5168b99315c602a370fbb04468a889b8811954f"}
Jul 14 17:04:16.694816 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.694609    2576 scope.go:117] "RemoveContainer" containerID="2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826"
Jul 14 17:04:16.703904 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.703885    2576 scope.go:117] "RemoveContainer" containerID="2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826"
Jul 14 17:04:16.704163 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:04:16.704144    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826\": container with ID starting with 2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826 not found: ID does not exist" containerID="2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826"
Jul 14 17:04:16.704215 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.704171    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826"} err="failed to get container status \"2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826\": rpc error: code = NotFound desc = could not find container \"2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826\": container with ID starting with 2354d06572e6e2c9b2b76d08b1a857c889bb4c8bf0d45f9a5d1de2024f593826 not found: ID does not exist"
Jul 14 17:04:16.723731 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.723709    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"]
Jul 14 17:04:16.727841 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:16.727822    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-845e65-7fbb76fcff-g5fn6"]
Jul 14 17:04:18.306929 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:18.306889    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3437e2-12c5-475e-a421-1354dd34b356" path="/var/lib/kubelet/pods/1e3437e2-12c5-475e-a421-1354dd34b356/volumes"
Jul 14 17:04:29.406372 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.406340    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"]
Jul 14 17:04:29.406914 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.406795    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3437e2-12c5-475e-a421-1354dd34b356" containerName="maas-api"
Jul 14 17:04:29.406914 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.406809    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3437e2-12c5-475e-a421-1354dd34b356" containerName="maas-api"
Jul 14 17:04:29.406914 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.406829    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e24c4f-3eab-46d3-8db3-3481366137ee" containerName="maas-api"
Jul 14 17:04:29.406914 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.406835    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e24c4f-3eab-46d3-8db3-3481366137ee" containerName="maas-api"
Jul 14 17:04:29.406914 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.406892    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e24c4f-3eab-46d3-8db3-3481366137ee" containerName="maas-api"
Jul 14 17:04:29.406914 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.406902    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3437e2-12c5-475e-a421-1354dd34b356" containerName="maas-api"
Jul 14 17:04:29.411236 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.411216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.415977 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.415953    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-2f2de5-serving-cert\""
Jul 14 17:04:29.503922 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.503879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"]
Jul 14 17:04:29.512065 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.512036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.512216 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.512090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.512268 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.512222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfxdg\" (UniqueName: \"kubernetes.io/projected/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-kube-api-access-qfxdg\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.613406 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.613372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.613599 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.613432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.613599 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.613505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfxdg\" (UniqueName: \"kubernetes.io/projected/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-kube-api-access-qfxdg\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.613599 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:04:29.613516    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-2f2de5-serving-cert: secret "maas-api-e2e-shared-a-2f2de5-serving-cert" not found
Jul 14 17:04:29.613599 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:04:29.613575    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls podName:cfbc1a3e-63dd-49d6-968a-fba61e6d753a nodeName:}" failed. No retries permitted until 2026-07-14 17:04:30.113558238 +0000 UTC m=+2059.243542416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls") pod "maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6" (UID: "cfbc1a3e-63dd-49d6-968a-fba61e6d753a") : secret "maas-api-e2e-shared-a-2f2de5-serving-cert" not found
Jul 14 17:04:29.614026 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.614007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:29.627561 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:29.627533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfxdg\" (UniqueName: \"kubernetes.io/projected/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-kube-api-access-qfxdg\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:30.118663 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:30.118601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:30.121095 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:30.121071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls\") pod \"maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") " pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:30.321551 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:30.321518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:30.532942 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:30.532914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"]
Jul 14 17:04:30.535614 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:04:30.535583    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbc1a3e_63dd_49d6_968a_fba61e6d753a.slice/crio-5325adfc83a6311aefd2dd64c2892a0d7aae53014c0f88622726a1c0322118c8 WatchSource:0}: Error finding container 5325adfc83a6311aefd2dd64c2892a0d7aae53014c0f88622726a1c0322118c8: Status 404 returned error can't find the container with id 5325adfc83a6311aefd2dd64c2892a0d7aae53014c0f88622726a1c0322118c8
Jul 14 17:04:30.761702 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:30.761665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6" event={"ID":"cfbc1a3e-63dd-49d6-968a-fba61e6d753a","Type":"ContainerStarted","Data":"5325adfc83a6311aefd2dd64c2892a0d7aae53014c0f88622726a1c0322118c8"}
Jul 14 17:04:31.767636 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:31.767591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6" event={"ID":"cfbc1a3e-63dd-49d6-968a-fba61e6d753a","Type":"ContainerStarted","Data":"2f181199701374b183bce210978a4a26f25d60f72d795376454d05c890df154b"}
Jul 14 17:04:31.768032 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:31.767765    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:31.807875 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:31.807822    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6" podStartSLOduration=2.401322008 podStartE2EDuration="2.807804582s" totalImagesPullingTime="406.482574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:04:31.806025187 +0000 UTC m=+2060.936009388" watchObservedRunningTime="2026-07-14 17:04:31.807804582 +0000 UTC m=+2060.937788779"
Jul 14 17:04:37.779208 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:37.779128    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:04:38.425020 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.424985    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"]
Jul 14 17:04:38.428757 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.428736    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.433872 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.433848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-21db6d-serving-cert\""
Jul 14 17:04:38.444579 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.444556    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"]
Jul 14 17:04:38.494495 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.494461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2lml\" (UniqueName: \"kubernetes.io/projected/7ce760d2-601a-456a-b977-74465b69655a-kube-api-access-c2lml\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.494495 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.494501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce760d2-601a-456a-b977-74465b69655a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.494742 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.494595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ce760d2-601a-456a-b977-74465b69655a-maas-api-tls\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.595296 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.595261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce760d2-601a-456a-b977-74465b69655a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.595498 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.595314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ce760d2-601a-456a-b977-74465b69655a-maas-api-tls\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.595498 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.595376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2lml\" (UniqueName: \"kubernetes.io/projected/7ce760d2-601a-456a-b977-74465b69655a-kube-api-access-c2lml\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.596032 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.596008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce760d2-601a-456a-b977-74465b69655a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.597934 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.597912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ce760d2-601a-456a-b977-74465b69655a-maas-api-tls\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.615144 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.615121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2lml\" (UniqueName: \"kubernetes.io/projected/7ce760d2-601a-456a-b977-74465b69655a-kube-api-access-c2lml\") pod \"maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") " pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.739249 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.739223    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:38.887507 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:38.887477    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"]
Jul 14 17:04:38.891033 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:04:38.891001    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce760d2_601a_456a_b977_74465b69655a.slice/crio-34e35114fda41451ddae5a117e838a881cfce40c15c6cc4dca598e6c2b3f3706 WatchSource:0}: Error finding container 34e35114fda41451ddae5a117e838a881cfce40c15c6cc4dca598e6c2b3f3706: Status 404 returned error can't find the container with id 34e35114fda41451ddae5a117e838a881cfce40c15c6cc4dca598e6c2b3f3706
Jul 14 17:04:39.806853 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:39.806818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr" event={"ID":"7ce760d2-601a-456a-b977-74465b69655a","Type":"ContainerStarted","Data":"3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1"}
Jul 14 17:04:39.807034 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:39.806876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr" event={"ID":"7ce760d2-601a-456a-b977-74465b69655a","Type":"ContainerStarted","Data":"34e35114fda41451ddae5a117e838a881cfce40c15c6cc4dca598e6c2b3f3706"}
Jul 14 17:04:39.807034 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:39.806913    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:39.838027 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:39.837961    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr" podStartSLOduration=1.298551888 podStartE2EDuration="1.837940448s" totalImagesPullingTime="539.38856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:04:39.837444655 +0000 UTC m=+2068.967428857" watchObservedRunningTime="2026-07-14 17:04:39.837940448 +0000 UTC m=+2068.967924652"
Jul 14 17:04:45.818646 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:45.818592    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:04:48.527139 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.527102    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"]
Jul 14 17:04:48.530450 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.530434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.537778 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.537735    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2f2de5\"/\"default-dockercfg-f8b2p\""
Jul 14 17:04:48.537931 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.537739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2f2de5\"/\"openshift-service-ca.crt\""
Jul 14 17:04:48.537931 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.537741    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2f2de5\"/\"kube-root-ca.crt\""
Jul 14 17:04:48.539798 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.539774    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2f2de5\"/\"auth-test-model-2f2de5-kserve-self-signed-certs\""
Jul 14 17:04:48.553837 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.553815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"]
Jul 14 17:04:48.580185 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.580155    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b41c20-9d88-4487-9028-f29f9166e577-tls-certs\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.580306 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.580190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8psxd\" (UniqueName: \"kubernetes.io/projected/c3b41c20-9d88-4487-9028-f29f9166e577-kube-api-access-8psxd\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.580306 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.580230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-home\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.580306 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.580280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-model-cache\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.580420 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.580338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-tmp-dir\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.580420 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.580408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-dshm\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681194 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-home\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681194 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-model-cache\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681436 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-tmp-dir\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681436 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-dshm\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681436 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b41c20-9d88-4487-9028-f29f9166e577-tls-certs\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681436 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8psxd\" (UniqueName: \"kubernetes.io/projected/c3b41c20-9d88-4487-9028-f29f9166e577-kube-api-access-8psxd\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681680 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-model-cache\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681680 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-tmp-dir\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.681773 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.681735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-home\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.683577 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.683555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-dshm\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.683780 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.683764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b41c20-9d88-4487-9028-f29f9166e577-tls-certs\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.697017 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.696988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8psxd\" (UniqueName: \"kubernetes.io/projected/c3b41c20-9d88-4487-9028-f29f9166e577-kube-api-access-8psxd\") pod \"auth-test-model-2f2de5-kserve-9bf97575-vpz7s\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") " pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:48.842430 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:48.842341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:49.010814 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:04:49.010779    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3b41c20_9d88_4487_9028_f29f9166e577.slice/crio-abbe067584632344450a0ef6286c846a7d2754a5393a4211b97eb64f9ea1f408 WatchSource:0}: Error finding container abbe067584632344450a0ef6286c846a7d2754a5393a4211b97eb64f9ea1f408: Status 404 returned error can't find the container with id abbe067584632344450a0ef6286c846a7d2754a5393a4211b97eb64f9ea1f408
Jul 14 17:04:49.011032 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:49.011008    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"]
Jul 14 17:04:49.862162 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:49.862128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s" event={"ID":"c3b41c20-9d88-4487-9028-f29f9166e577","Type":"ContainerStarted","Data":"0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73"}
Jul 14 17:04:49.862162 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:49.862169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s" event={"ID":"c3b41c20-9d88-4487-9028-f29f9166e577","Type":"ContainerStarted","Data":"abbe067584632344450a0ef6286c846a7d2754a5393a4211b97eb64f9ea1f408"}
Jul 14 17:04:49.893408 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:49.893362    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s" podStartSLOduration=1.893341288 podStartE2EDuration="1.893341288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:04:49.889649692 +0000 UTC m=+2079.019633883" watchObservedRunningTime="2026-07-14 17:04:49.893341288 +0000 UTC m=+2079.023325511"
Jul 14 17:04:58.842872 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:58.842816    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:58.843349 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:58.842898    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:58.855044 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:58.855020    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:04:58.916449 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:04:58.916423    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:07:44.976726 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:44.976590    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"]
Jul 14 17:07:54.505960 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.505921    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"]
Jul 14 17:07:54.509664 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.509642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.513440 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.513406    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2f2de5\"/\"sub-test-model-2f2de5-kserve-self-signed-certs\""
Jul 14 17:07:54.520988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.520964    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"]
Jul 14 17:07:54.548882 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.548841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-home\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.548882 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.548877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-dshm\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.549088 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.548918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tls-certs\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.549088 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.548996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tmp-dir\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.549088 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.549017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-model-cache\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.549088 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.549037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cpnt\" (UniqueName: \"kubernetes.io/projected/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-kube-api-access-6cpnt\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649473 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tmp-dir\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649473 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-model-cache\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649702 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cpnt\" (UniqueName: \"kubernetes.io/projected/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-kube-api-access-6cpnt\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649702 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-home\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649702 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-dshm\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649702 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tls-certs\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649887 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-model-cache\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.649946 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.649913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tmp-dir\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.650089 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.650070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-home\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.652057 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.652034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-dshm\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.652180 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.652163    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tls-certs\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.659077 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.659055    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cpnt\" (UniqueName: \"kubernetes.io/projected/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-kube-api-access-6cpnt\") pod \"sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") " pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.819512 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.819430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:07:54.965513 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:54.965485    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"]
Jul 14 17:07:54.967579 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:07:54.967555    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8f0636d_1a87_4040_8c47_9a6f9beed3a6.slice/crio-77830cdf755f5cee427fd4adb82036ee52bf08ffab30a9130b591d16ac0d5b64 WatchSource:0}: Error finding container 77830cdf755f5cee427fd4adb82036ee52bf08ffab30a9130b591d16ac0d5b64: Status 404 returned error can't find the container with id 77830cdf755f5cee427fd4adb82036ee52bf08ffab30a9130b591d16ac0d5b64
Jul 14 17:07:55.780515 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:55.780480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl" event={"ID":"a8f0636d-1a87-4040-8c47-9a6f9beed3a6","Type":"ContainerStarted","Data":"137b8c5b9014767a066f5a6b28d1fd33db9a0582bfb4e0f1f0dc16aed9e3353a"}
Jul 14 17:07:55.780515 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:55.780520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl" event={"ID":"a8f0636d-1a87-4040-8c47-9a6f9beed3a6","Type":"ContainerStarted","Data":"77830cdf755f5cee427fd4adb82036ee52bf08ffab30a9130b591d16ac0d5b64"}
Jul 14 17:07:55.808217 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:55.808167    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl" podStartSLOduration=1.80815522 podStartE2EDuration="1.80815522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:07:55.80602817 +0000 UTC m=+2264.936012381" watchObservedRunningTime="2026-07-14 17:07:55.80815522 +0000 UTC m=+2264.938139451"
Jul 14 17:07:59.996794 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:07:59.996736    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s" podUID="c3b41c20-9d88-4487-9028-f29f9166e577" containerName="main" containerID="cri-o://0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73" gracePeriod=45
Jul 14 17:08:00.260117 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.260057    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:08:00.299255 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8psxd\" (UniqueName: \"kubernetes.io/projected/c3b41c20-9d88-4487-9028-f29f9166e577-kube-api-access-8psxd\") pod \"c3b41c20-9d88-4487-9028-f29f9166e577\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") "
Jul 14 17:08:00.299410 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299261    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-dshm\") pod \"c3b41c20-9d88-4487-9028-f29f9166e577\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") "
Jul 14 17:08:00.299410 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299292    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-home\") pod \"c3b41c20-9d88-4487-9028-f29f9166e577\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") "
Jul 14 17:08:00.299410 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-model-cache\") pod \"c3b41c20-9d88-4487-9028-f29f9166e577\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") "
Jul 14 17:08:00.299410 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299387    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-tmp-dir\") pod \"c3b41c20-9d88-4487-9028-f29f9166e577\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") "
Jul 14 17:08:00.299638 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299440    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b41c20-9d88-4487-9028-f29f9166e577-tls-certs\") pod \"c3b41c20-9d88-4487-9028-f29f9166e577\" (UID: \"c3b41c20-9d88-4487-9028-f29f9166e577\") "
Jul 14 17:08:00.299638 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299581    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3b41c20-9d88-4487-9028-f29f9166e577" (UID: "c3b41c20-9d88-4487-9028-f29f9166e577"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:08:00.299749 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299607    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-home" (OuterVolumeSpecName: "home") pod "c3b41c20-9d88-4487-9028-f29f9166e577" (UID: "c3b41c20-9d88-4487-9028-f29f9166e577"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:08:00.299804 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299759    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-model-cache\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:08:00.299804 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299778    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-home\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:08:00.299911 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.299798    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3b41c20-9d88-4487-9028-f29f9166e577" (UID: "c3b41c20-9d88-4487-9028-f29f9166e577"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:08:00.301760 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.301738    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3b41c20-9d88-4487-9028-f29f9166e577-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3b41c20-9d88-4487-9028-f29f9166e577" (UID: "c3b41c20-9d88-4487-9028-f29f9166e577"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:08:00.301860 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.301794    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-dshm" (OuterVolumeSpecName: "dshm") pod "c3b41c20-9d88-4487-9028-f29f9166e577" (UID: "c3b41c20-9d88-4487-9028-f29f9166e577"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:08:00.302123 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.302102    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3b41c20-9d88-4487-9028-f29f9166e577-kube-api-access-8psxd" (OuterVolumeSpecName: "kube-api-access-8psxd") pod "c3b41c20-9d88-4487-9028-f29f9166e577" (UID: "c3b41c20-9d88-4487-9028-f29f9166e577"). InnerVolumeSpecName "kube-api-access-8psxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:08:00.400591 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.400553    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-tmp-dir\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:08:00.400591 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.400589    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b41c20-9d88-4487-9028-f29f9166e577-tls-certs\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:08:00.400591 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.400598    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8psxd\" (UniqueName: \"kubernetes.io/projected/c3b41c20-9d88-4487-9028-f29f9166e577-kube-api-access-8psxd\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:08:00.400591 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.400607    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b41c20-9d88-4487-9028-f29f9166e577-dshm\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:08:00.806798 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.806769    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3b41c20-9d88-4487-9028-f29f9166e577" containerID="0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73" exitCode=0
Jul 14 17:08:00.806982 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.806812    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"
Jul 14 17:08:00.806982 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.806857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s" event={"ID":"c3b41c20-9d88-4487-9028-f29f9166e577","Type":"ContainerDied","Data":"0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73"}
Jul 14 17:08:00.806982 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.806904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s" event={"ID":"c3b41c20-9d88-4487-9028-f29f9166e577","Type":"ContainerDied","Data":"abbe067584632344450a0ef6286c846a7d2754a5393a4211b97eb64f9ea1f408"}
Jul 14 17:08:00.806982 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.806924    2576 scope.go:117] "RemoveContainer" containerID="0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73"
Jul 14 17:08:00.816651 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.816613    2576 scope.go:117] "RemoveContainer" containerID="0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73"
Jul 14 17:08:00.816953 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:08:00.816926    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73\": container with ID starting with 0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73 not found: ID does not exist" containerID="0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73"
Jul 14 17:08:00.817061 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.816962    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73"} err="failed to get container status \"0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73\": rpc error: code = NotFound desc = could not find container \"0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73\": container with ID starting with 0390e98f36f3b7c22734fb7b9340054f669b933b5c83552237d7ad77f7281a73 not found: ID does not exist"
Jul 14 17:08:00.831800 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.831754    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"]
Jul 14 17:08:00.834397 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:00.834373    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/auth-test-model-2f2de5-kserve-9bf97575-vpz7s"]
Jul 14 17:08:02.306881 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:02.306844    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3b41c20-9d88-4487-9028-f29f9166e577" path="/var/lib/kubelet/pods/c3b41c20-9d88-4487-9028-f29f9166e577/volumes"
Jul 14 17:08:04.820523 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:04.820480    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:08:04.820930 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:04.820543    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:08:04.835531 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:04.835503    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:08:04.847343 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:08:04.847315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:09:22.141884 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:22.141805    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"]
Jul 14 17:09:30.515148 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.515111    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"]
Jul 14 17:09:30.515598 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.515512    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b41c20-9d88-4487-9028-f29f9166e577" containerName="main"
Jul 14 17:09:30.515598 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.515523    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b41c20-9d88-4487-9028-f29f9166e577" containerName="main"
Jul 14 17:09:30.515598 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.515578    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b41c20-9d88-4487-9028-f29f9166e577" containerName="main"
Jul 14 17:09:30.518411 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.518396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.521663 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.521643    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2f2de5\"/\"rate-test-model-2f2de5-kserve-self-signed-certs\""
Jul 14 17:09:30.533779 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.533755    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"]
Jul 14 17:09:30.619475 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.619441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-dshm\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.619475 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.619474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tmp-dir\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.619743 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.619585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tls-certs\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.619743 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.619674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jvj9\" (UniqueName: \"kubernetes.io/projected/40874b67-8e7b-42d2-a8ac-3868a924ffb9-kube-api-access-9jvj9\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.619743 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.619731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-home\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.619864 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.619761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-model-cache\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721070 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tls-certs\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721244 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jvj9\" (UniqueName: \"kubernetes.io/projected/40874b67-8e7b-42d2-a8ac-3868a924ffb9-kube-api-access-9jvj9\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721244 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-home\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721244 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-model-cache\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721244 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-dshm\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721244 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tmp-dir\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721673 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-home\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721788 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-model-cache\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.721788 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.721618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tmp-dir\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.723380 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.723359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-dshm\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.723550 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.723533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tls-certs\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.731127 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.731101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jvj9\" (UniqueName: \"kubernetes.io/projected/40874b67-8e7b-42d2-a8ac-3868a924ffb9-kube-api-access-9jvj9\") pod \"rate-test-model-2f2de5-kserve-65f56955bc-8fm6h\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") " pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.827381 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.827309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:30.974286 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:30.974253    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"]
Jul 14 17:09:30.974783 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:09:30.974757    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40874b67_8e7b_42d2_a8ac_3868a924ffb9.slice/crio-5c60eed8222481facef1361b19eb00f37045ddb2e7474c69dfd8a67d76b0c995 WatchSource:0}: Error finding container 5c60eed8222481facef1361b19eb00f37045ddb2e7474c69dfd8a67d76b0c995: Status 404 returned error can't find the container with id 5c60eed8222481facef1361b19eb00f37045ddb2e7474c69dfd8a67d76b0c995
Jul 14 17:09:31.262667 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:31.262602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h" event={"ID":"40874b67-8e7b-42d2-a8ac-3868a924ffb9","Type":"ContainerStarted","Data":"4cfd42d2986da228c76255d48f22acf3ac0a85f123ad636dde4f51e22d13b1b7"}
Jul 14 17:09:31.262872 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:31.262683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h" event={"ID":"40874b67-8e7b-42d2-a8ac-3868a924ffb9","Type":"ContainerStarted","Data":"5c60eed8222481facef1361b19eb00f37045ddb2e7474c69dfd8a67d76b0c995"}
Jul 14 17:09:31.288282 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:31.288236    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h" podStartSLOduration=1.288221633 podStartE2EDuration="1.288221633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:09:31.284693318 +0000 UTC m=+2360.414677518" watchObservedRunningTime="2026-07-14 17:09:31.288221633 +0000 UTC m=+2360.418205833"
Jul 14 17:09:37.161374 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.161334    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl" podUID="a8f0636d-1a87-4040-8c47-9a6f9beed3a6" containerName="main" containerID="cri-o://137b8c5b9014767a066f5a6b28d1fd33db9a0582bfb4e0f1f0dc16aed9e3353a" gracePeriod=45
Jul 14 17:09:37.295254 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.295220    2576 generic.go:356] "Generic (PLEG): container finished" podID="a8f0636d-1a87-4040-8c47-9a6f9beed3a6" containerID="137b8c5b9014767a066f5a6b28d1fd33db9a0582bfb4e0f1f0dc16aed9e3353a" exitCode=0
Jul 14 17:09:37.295408 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.295293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl" event={"ID":"a8f0636d-1a87-4040-8c47-9a6f9beed3a6","Type":"ContainerDied","Data":"137b8c5b9014767a066f5a6b28d1fd33db9a0582bfb4e0f1f0dc16aed9e3353a"}
Jul 14 17:09:37.423251 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.423198    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:09:37.583449 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583417    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-model-cache\") pod \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") "
Jul 14 17:09:37.583664 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583477    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-home\") pod \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") "
Jul 14 17:09:37.583664 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583530    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-dshm\") pod \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") "
Jul 14 17:09:37.583664 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583553    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tmp-dir\") pod \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") "
Jul 14 17:09:37.583664 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cpnt\" (UniqueName: \"kubernetes.io/projected/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-kube-api-access-6cpnt\") pod \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") "
Jul 14 17:09:37.583892 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583686    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tls-certs\") pod \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\" (UID: \"a8f0636d-1a87-4040-8c47-9a6f9beed3a6\") "
Jul 14 17:09:37.583892 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583693    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8f0636d-1a87-4040-8c47-9a6f9beed3a6" (UID: "a8f0636d-1a87-4040-8c47-9a6f9beed3a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:09:37.584026 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583887    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-home" (OuterVolumeSpecName: "home") pod "a8f0636d-1a87-4040-8c47-9a6f9beed3a6" (UID: "a8f0636d-1a87-4040-8c47-9a6f9beed3a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:09:37.584026 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583902    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8f0636d-1a87-4040-8c47-9a6f9beed3a6" (UID: "a8f0636d-1a87-4040-8c47-9a6f9beed3a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:09:37.584026 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583982    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tmp-dir\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:09:37.584026 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.583997    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-model-cache\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:09:37.584026 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.584010    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-home\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:09:37.585814 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.585784    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-dshm" (OuterVolumeSpecName: "dshm") pod "a8f0636d-1a87-4040-8c47-9a6f9beed3a6" (UID: "a8f0636d-1a87-4040-8c47-9a6f9beed3a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:09:37.585814 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.585788    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8f0636d-1a87-4040-8c47-9a6f9beed3a6" (UID: "a8f0636d-1a87-4040-8c47-9a6f9beed3a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:09:37.585814 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.585787    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-kube-api-access-6cpnt" (OuterVolumeSpecName: "kube-api-access-6cpnt") pod "a8f0636d-1a87-4040-8c47-9a6f9beed3a6" (UID: "a8f0636d-1a87-4040-8c47-9a6f9beed3a6"). InnerVolumeSpecName "kube-api-access-6cpnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:09:37.684669 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.684583    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-tls-certs\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:09:37.684669 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.684607    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-dshm\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:09:37.684669 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:37.684617    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cpnt\" (UniqueName: \"kubernetes.io/projected/a8f0636d-1a87-4040-8c47-9a6f9beed3a6-kube-api-access-6cpnt\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:09:38.301970 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:38.301939    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"
Jul 14 17:09:38.306425 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:38.306391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl" event={"ID":"a8f0636d-1a87-4040-8c47-9a6f9beed3a6","Type":"ContainerDied","Data":"77830cdf755f5cee427fd4adb82036ee52bf08ffab30a9130b591d16ac0d5b64"}
Jul 14 17:09:38.306425 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:38.306429    2576 scope.go:117] "RemoveContainer" containerID="137b8c5b9014767a066f5a6b28d1fd33db9a0582bfb4e0f1f0dc16aed9e3353a"
Jul 14 17:09:38.337039 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:38.337010    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"]
Jul 14 17:09:38.350848 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:38.350823    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/sub-test-model-2f2de5-kserve-568c8cc5bc-js5tl"]
Jul 14 17:09:40.306645 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:40.306598    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8f0636d-1a87-4040-8c47-9a6f9beed3a6" path="/var/lib/kubelet/pods/a8f0636d-1a87-4040-8c47-9a6f9beed3a6/volumes"
Jul 14 17:09:40.827739 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:40.827706    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:40.827911 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:40.827749    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:40.844347 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:40.844323    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:09:41.327404 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:09:41.327377    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:10:33.479732 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:33.479656    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"]
Jul 14 17:10:36.463052 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.463020    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"]
Jul 14 17:10:36.463428 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.463238    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6" podUID="cfbc1a3e-63dd-49d6-968a-fba61e6d753a" containerName="maas-api" containerID="cri-o://2f181199701374b183bce210978a4a26f25d60f72d795376454d05c890df154b" gracePeriod=30
Jul 14 17:10:36.597709 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.597680    2576 generic.go:356] "Generic (PLEG): container finished" podID="cfbc1a3e-63dd-49d6-968a-fba61e6d753a" containerID="2f181199701374b183bce210978a4a26f25d60f72d795376454d05c890df154b" exitCode=0
Jul 14 17:10:36.597854 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.597716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6" event={"ID":"cfbc1a3e-63dd-49d6-968a-fba61e6d753a","Type":"ContainerDied","Data":"2f181199701374b183bce210978a4a26f25d60f72d795376454d05c890df154b"}
Jul 14 17:10:36.720331 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.720268    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:10:36.827728 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.827699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfxdg\" (UniqueName: \"kubernetes.io/projected/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-kube-api-access-qfxdg\") pod \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") "
Jul 14 17:10:36.827895 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.827763    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls\") pod \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") "
Jul 14 17:10:36.827895 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.827783    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-openshift-service-ca\") pod \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\" (UID: \"cfbc1a3e-63dd-49d6-968a-fba61e6d753a\") "
Jul 14 17:10:36.828231 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.828202    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cfbc1a3e-63dd-49d6-968a-fba61e6d753a" (UID: "cfbc1a3e-63dd-49d6-968a-fba61e6d753a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:10:36.829783 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.829759    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cfbc1a3e-63dd-49d6-968a-fba61e6d753a" (UID: "cfbc1a3e-63dd-49d6-968a-fba61e6d753a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:10:36.829886 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.829875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-kube-api-access-qfxdg" (OuterVolumeSpecName: "kube-api-access-qfxdg") pod "cfbc1a3e-63dd-49d6-968a-fba61e6d753a" (UID: "cfbc1a3e-63dd-49d6-968a-fba61e6d753a"). InnerVolumeSpecName "kube-api-access-qfxdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:10:36.928948 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.928914    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:36.928948 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.928943    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:36.928948 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:36.928953    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfxdg\" (UniqueName: \"kubernetes.io/projected/cfbc1a3e-63dd-49d6-968a-fba61e6d753a-kube-api-access-qfxdg\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:37.603961 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:37.603938    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"
Jul 14 17:10:37.604380 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:37.603935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6" event={"ID":"cfbc1a3e-63dd-49d6-968a-fba61e6d753a","Type":"ContainerDied","Data":"5325adfc83a6311aefd2dd64c2892a0d7aae53014c0f88622726a1c0322118c8"}
Jul 14 17:10:37.604380 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:37.604071    2576 scope.go:117] "RemoveContainer" containerID="2f181199701374b183bce210978a4a26f25d60f72d795376454d05c890df154b"
Jul 14 17:10:37.635198 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:37.635174    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"]
Jul 14 17:10:37.639497 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:37.639468    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2f2de5-75bd987d-2jdd6"]
Jul 14 17:10:38.306971 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:38.306935    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfbc1a3e-63dd-49d6-968a-fba61e6d753a" path="/var/lib/kubelet/pods/cfbc1a3e-63dd-49d6-968a-fba61e6d753a/volumes"
Jul 14 17:10:48.500362 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.500290    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h" podUID="40874b67-8e7b-42d2-a8ac-3868a924ffb9" containerName="main" containerID="cri-o://4cfd42d2986da228c76255d48f22acf3ac0a85f123ad636dde4f51e22d13b1b7" gracePeriod=45
Jul 14 17:10:48.663986 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.663952    2576 generic.go:356] "Generic (PLEG): container finished" podID="40874b67-8e7b-42d2-a8ac-3868a924ffb9" containerID="4cfd42d2986da228c76255d48f22acf3ac0a85f123ad636dde4f51e22d13b1b7" exitCode=0
Jul 14 17:10:48.663986 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.663995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h" event={"ID":"40874b67-8e7b-42d2-a8ac-3868a924ffb9","Type":"ContainerDied","Data":"4cfd42d2986da228c76255d48f22acf3ac0a85f123ad636dde4f51e22d13b1b7"}
Jul 14 17:10:48.767838 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.767812    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:10:48.830411 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830377    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tls-certs\") pod \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") "
Jul 14 17:10:48.830411 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830412    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-model-cache\") pod \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") "
Jul 14 17:10:48.830683 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830455    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-dshm\") pod \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") "
Jul 14 17:10:48.830683 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tmp-dir\") pod \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") "
Jul 14 17:10:48.830683 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830527    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jvj9\" (UniqueName: \"kubernetes.io/projected/40874b67-8e7b-42d2-a8ac-3868a924ffb9-kube-api-access-9jvj9\") pod \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") "
Jul 14 17:10:48.830683 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830550    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-home\") pod \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\" (UID: \"40874b67-8e7b-42d2-a8ac-3868a924ffb9\") "
Jul 14 17:10:48.830899 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830724    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-model-cache" (OuterVolumeSpecName: "model-cache") pod "40874b67-8e7b-42d2-a8ac-3868a924ffb9" (UID: "40874b67-8e7b-42d2-a8ac-3868a924ffb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:10:48.830976 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830921    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-model-cache\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:48.831028 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.830988    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-home" (OuterVolumeSpecName: "home") pod "40874b67-8e7b-42d2-a8ac-3868a924ffb9" (UID: "40874b67-8e7b-42d2-a8ac-3868a924ffb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:10:48.831083 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.831057    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40874b67-8e7b-42d2-a8ac-3868a924ffb9" (UID: "40874b67-8e7b-42d2-a8ac-3868a924ffb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:10:48.832746 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.832714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-dshm" (OuterVolumeSpecName: "dshm") pod "40874b67-8e7b-42d2-a8ac-3868a924ffb9" (UID: "40874b67-8e7b-42d2-a8ac-3868a924ffb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:10:48.832856 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.832813    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40874b67-8e7b-42d2-a8ac-3868a924ffb9-kube-api-access-9jvj9" (OuterVolumeSpecName: "kube-api-access-9jvj9") pod "40874b67-8e7b-42d2-a8ac-3868a924ffb9" (UID: "40874b67-8e7b-42d2-a8ac-3868a924ffb9"). InnerVolumeSpecName "kube-api-access-9jvj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:10:48.832903 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.832869    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40874b67-8e7b-42d2-a8ac-3868a924ffb9" (UID: "40874b67-8e7b-42d2-a8ac-3868a924ffb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:10:48.932279 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.932243    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jvj9\" (UniqueName: \"kubernetes.io/projected/40874b67-8e7b-42d2-a8ac-3868a924ffb9-kube-api-access-9jvj9\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:48.932279 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.932273    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-home\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:48.932279 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.932283    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tls-certs\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:48.932514 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.932292    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-dshm\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:48.932514 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:48.932321    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40874b67-8e7b-42d2-a8ac-3868a924ffb9-tmp-dir\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:10:49.670299 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:49.670267    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"
Jul 14 17:10:49.670299 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:49.670283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h" event={"ID":"40874b67-8e7b-42d2-a8ac-3868a924ffb9","Type":"ContainerDied","Data":"5c60eed8222481facef1361b19eb00f37045ddb2e7474c69dfd8a67d76b0c995"}
Jul 14 17:10:49.670803 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:49.670330    2576 scope.go:117] "RemoveContainer" containerID="4cfd42d2986da228c76255d48f22acf3ac0a85f123ad636dde4f51e22d13b1b7"
Jul 14 17:10:49.698342 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:49.698311    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"]
Jul 14 17:10:49.717230 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:49.717202    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2f2de5/rate-test-model-2f2de5-kserve-65f56955bc-8fm6h"]
Jul 14 17:10:50.307780 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:10:50.307746    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40874b67-8e7b-42d2-a8ac-3868a924ffb9" path="/var/lib/kubelet/pods/40874b67-8e7b-42d2-a8ac-3868a924ffb9/volumes"
Jul 14 17:11:19.818149 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:19.818113    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"]
Jul 14 17:11:19.818674 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:19.818366    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr" podUID="7ce760d2-601a-456a-b977-74465b69655a" containerName="maas-api" containerID="cri-o://3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1" gracePeriod=30
Jul 14 17:11:20.067090 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.067063    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:11:20.111988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.111915    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ce760d2-601a-456a-b977-74465b69655a-maas-api-tls\") pod \"7ce760d2-601a-456a-b977-74465b69655a\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") "
Jul 14 17:11:20.111988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.111965    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce760d2-601a-456a-b977-74465b69655a-openshift-service-ca\") pod \"7ce760d2-601a-456a-b977-74465b69655a\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") "
Jul 14 17:11:20.112212 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.112068    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2lml\" (UniqueName: \"kubernetes.io/projected/7ce760d2-601a-456a-b977-74465b69655a-kube-api-access-c2lml\") pod \"7ce760d2-601a-456a-b977-74465b69655a\" (UID: \"7ce760d2-601a-456a-b977-74465b69655a\") "
Jul 14 17:11:20.120644 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.112381    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ce760d2-601a-456a-b977-74465b69655a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ce760d2-601a-456a-b977-74465b69655a" (UID: "7ce760d2-601a-456a-b977-74465b69655a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:11:20.120644 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.114939    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce760d2-601a-456a-b977-74465b69655a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ce760d2-601a-456a-b977-74465b69655a" (UID: "7ce760d2-601a-456a-b977-74465b69655a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:11:20.121105 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.121079    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce760d2-601a-456a-b977-74465b69655a-kube-api-access-c2lml" (OuterVolumeSpecName: "kube-api-access-c2lml") pod "7ce760d2-601a-456a-b977-74465b69655a" (UID: "7ce760d2-601a-456a-b977-74465b69655a"). InnerVolumeSpecName "kube-api-access-c2lml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:11:20.213329 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.213295    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce760d2-601a-456a-b977-74465b69655a-openshift-service-ca\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:11:20.213329 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.213324    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2lml\" (UniqueName: \"kubernetes.io/projected/7ce760d2-601a-456a-b977-74465b69655a-kube-api-access-c2lml\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:11:20.213329 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.213335    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ce760d2-601a-456a-b977-74465b69655a-maas-api-tls\") on node \"ip-10-0-141-173.ec2.internal\" DevicePath \"\""
Jul 14 17:11:20.822578 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.822541    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ce760d2-601a-456a-b977-74465b69655a" containerID="3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1" exitCode=0
Jul 14 17:11:20.823072 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.822598    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"
Jul 14 17:11:20.823072 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.822640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr" event={"ID":"7ce760d2-601a-456a-b977-74465b69655a","Type":"ContainerDied","Data":"3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1"}
Jul 14 17:11:20.823072 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.822708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr" event={"ID":"7ce760d2-601a-456a-b977-74465b69655a","Type":"ContainerDied","Data":"34e35114fda41451ddae5a117e838a881cfce40c15c6cc4dca598e6c2b3f3706"}
Jul 14 17:11:20.823072 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.822746    2576 scope.go:117] "RemoveContainer" containerID="3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1"
Jul 14 17:11:20.831445 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.831413    2576 scope.go:117] "RemoveContainer" containerID="3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1"
Jul 14 17:11:20.831733 ip-10-0-141-173 kubenswrapper[2576]: E0714 17:11:20.831713    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1\": container with ID starting with 3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1 not found: ID does not exist" containerID="3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1"
Jul 14 17:11:20.831814 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.831746    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1"} err="failed to get container status \"3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1\": rpc error: code = NotFound desc = could not find container \"3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1\": container with ID starting with 3b0d54270f4935d37ec62477fd1e538ae85f6f51ec8b6a07f14e7996c98738c1 not found: ID does not exist"
Jul 14 17:11:20.855491 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.855461    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"]
Jul 14 17:11:20.864375 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:20.864349    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-21db6d-6bdf8f5d44-qdgfr"]
Jul 14 17:11:22.308116 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:22.308073    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ce760d2-601a-456a-b977-74465b69655a" path="/var/lib/kubelet/pods/7ce760d2-601a-456a-b977-74465b69655a/volumes"
Jul 14 17:11:33.346410 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:33.346375    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d6ldf_8db53a08-7cc8-48be-a4e2-7f77dc56d12d/manager/0.log"
Jul 14 17:11:33.486306 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:33.486269    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cm7zf_2a58127c-721c-478b-8eea-1b07081782da/manager/0.log"
Jul 14 17:11:33.637060 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:33.636972    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-686f669d5d-vzwm5_fad16b8e-9d68-48b4-8565-66ac531b0d55/maas-api/0.log"
Jul 14 17:11:33.762192 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:33.762167    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734125-rttt5_ea5041b6-18a5-4f15-a28c-c95996cb02ec/cleanup/0.log"
Jul 14 17:11:33.884292 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:33.884261    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734140-6vz2g_a4770499-e47b-4d17-83f2-ad51baacad8b/cleanup/0.log"
Jul 14 17:11:34.047980 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:34.047951    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68c8c8b776-w2kvf_832f4dc4-c5f0-4d3c-959e-97818ad91985/manager/0.log"
Jul 14 17:11:34.205044 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:34.205017    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z96dt_4c2548f1-2fa7-4f57-832f-51688e9d276f/server/0.log"
Jul 14 17:11:34.346469 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:34.346377    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rk4x6_f0b356a9-867a-42db-999f-f69c9a2b6411/manager/0.log"
Jul 14 17:11:34.796046 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:34.796022    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn_bc56f196-b2b3-43a2-bc8d-30d8ebe41019/copy-manifests/0.log"
Jul 14 17:11:34.817314 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:34.817284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn_bc56f196-b2b3-43a2-bc8d-30d8ebe41019/manager/0.log"
Jul 14 17:11:34.954535 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:34.954506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jh52x_b03a6cfc-f29b-4fed-91e3-2f33c0d26416/postgres/0.log"
Jul 14 17:11:36.590826 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:36.590794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-w2lqb_091922d3-0f1c-41c4-9185-962b30cc28bd/manager/0.log"
Jul 14 17:11:36.721534 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:36.721498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kjqpz_05c0e85e-428b-4be3-803b-02e862c919af/manager/0.log"
Jul 14 17:11:36.988306 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:36.988277    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z279n_9759d3b9-eaef-44c5-8d05-fcfa4dceee23/registry-server/0.log"
Jul 14 17:11:37.123152 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:37.123127    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l7pcp_e6a9d75c-6355-4664-9758-75de34110cfe/manager/0.log"
Jul 14 17:11:37.383505 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:37.383434    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s457m_3db43a8e-19d4-4897-af3c-eff9e29b454a/manager/0.log"
Jul 14 17:11:38.027645 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:38.027591    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-7w7b8_d30c1a98-0f07-47ef-9340-1bc3de03a68d/kube-auth-proxy/0.log"
Jul 14 17:11:38.438283 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:38.438202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s5d2_6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4/payload-pre-processing/0.log"
Jul 14 17:11:38.571495 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:38.571461    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mgkmk_47aa168d-9295-4669-999c-a214a8d25d05/payload-processing/0.log"
Jul 14 17:11:39.111431 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:39.111399    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-h5kkw_f09300ef-fea5-4a91-8dbd-07a027f871c8/main/0.log"
Jul 14 17:11:39.382249 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:39.382159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8wrvk_4f34f880-d238-4e89-b688-af81e149129c/main/0.log"
Jul 14 17:11:47.360989 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:47.360960    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ngd5g_aa5c33ea-b97d-43b0-b2c0-cb13816e0284/global-pull-secret-syncer/0.log"
Jul 14 17:11:47.624613 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:47.624529    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ngqzw_14347276-abe7-4b13-bb5f-fc30155dde49/konnectivity-agent/0.log"
Jul 14 17:11:47.757415 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:47.757382    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-173.ec2.internal_6261ced1e7db1c9710339923c191579e/haproxy/0.log"
Jul 14 17:11:52.565944 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:52.565906    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-w2lqb_091922d3-0f1c-41c4-9185-962b30cc28bd/manager/0.log"
Jul 14 17:11:52.630143 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:52.630117    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kjqpz_05c0e85e-428b-4be3-803b-02e862c919af/manager/0.log"
Jul 14 17:11:52.743791 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:52.743757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z279n_9759d3b9-eaef-44c5-8d05-fcfa4dceee23/registry-server/0.log"
Jul 14 17:11:52.921498 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:52.921470    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l7pcp_e6a9d75c-6355-4664-9758-75de34110cfe/manager/0.log"
Jul 14 17:11:53.073738 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:53.073707    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s457m_3db43a8e-19d4-4897-af3c-eff9e29b454a/manager/0.log"
Jul 14 17:11:55.630961 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.630919    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vlb6d_9f4cd8ca-3ea8-493e-91ff-f0201e965c74/node-exporter/0.log"
Jul 14 17:11:55.671448 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.671415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vlb6d_9f4cd8ca-3ea8-493e-91ff-f0201e965c74/kube-rbac-proxy/0.log"
Jul 14 17:11:55.719985 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.719959    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vlb6d_9f4cd8ca-3ea8-493e-91ff-f0201e965c74/init-textfile/0.log"
Jul 14 17:11:55.758364 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.758324    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vwtzr_0b824155-9e82-4beb-a22f-3defb5ee8b4b/kube-rbac-proxy-main/0.log"
Jul 14 17:11:55.786147 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.786118    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vwtzr_0b824155-9e82-4beb-a22f-3defb5ee8b4b/kube-rbac-proxy-self/0.log"
Jul 14 17:11:55.820813 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.820790    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vwtzr_0b824155-9e82-4beb-a22f-3defb5ee8b4b/openshift-state-metrics/0.log"
Jul 14 17:11:55.884809 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.884731    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64c0a9af-03fc-4e0d-b28c-3e9036e89b58/prometheus/0.log"
Jul 14 17:11:55.927301 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.927271    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64c0a9af-03fc-4e0d-b28c-3e9036e89b58/config-reloader/0.log"
Jul 14 17:11:55.970739 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:55.970701    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64c0a9af-03fc-4e0d-b28c-3e9036e89b58/thanos-sidecar/0.log"
Jul 14 17:11:56.002691 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.002665    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64c0a9af-03fc-4e0d-b28c-3e9036e89b58/kube-rbac-proxy-web/0.log"
Jul 14 17:11:56.048475 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.048449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64c0a9af-03fc-4e0d-b28c-3e9036e89b58/kube-rbac-proxy/0.log"
Jul 14 17:11:56.085031 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.084999    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64c0a9af-03fc-4e0d-b28c-3e9036e89b58/kube-rbac-proxy-thanos/0.log"
Jul 14 17:11:56.127167 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.127140    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64c0a9af-03fc-4e0d-b28c-3e9036e89b58/init-config-reloader/0.log"
Jul 14 17:11:56.784097 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784067    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"]
Jul 14 17:11:56.784468 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784451    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfbc1a3e-63dd-49d6-968a-fba61e6d753a" containerName="maas-api"
Jul 14 17:11:56.784468 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784464    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfbc1a3e-63dd-49d6-968a-fba61e6d753a" containerName="maas-api"
Jul 14 17:11:56.784540 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784483    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40874b67-8e7b-42d2-a8ac-3868a924ffb9" containerName="main"
Jul 14 17:11:56.784540 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784488    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="40874b67-8e7b-42d2-a8ac-3868a924ffb9" containerName="main"
Jul 14 17:11:56.784540 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784497    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce760d2-601a-456a-b977-74465b69655a" containerName="maas-api"
Jul 14 17:11:56.784540 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784502    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce760d2-601a-456a-b977-74465b69655a" containerName="maas-api"
Jul 14 17:11:56.784540 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784509    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f0636d-1a87-4040-8c47-9a6f9beed3a6" containerName="main"
Jul 14 17:11:56.784540 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784514    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f0636d-1a87-4040-8c47-9a6f9beed3a6" containerName="main"
Jul 14 17:11:56.784747 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784587    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="40874b67-8e7b-42d2-a8ac-3868a924ffb9" containerName="main"
Jul 14 17:11:56.784747 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784596    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfbc1a3e-63dd-49d6-968a-fba61e6d753a" containerName="maas-api"
Jul 14 17:11:56.784747 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784603    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f0636d-1a87-4040-8c47-9a6f9beed3a6" containerName="main"
Jul 14 17:11:56.784747 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.784611    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ce760d2-601a-456a-b977-74465b69655a" containerName="maas-api"
Jul 14 17:11:56.787467 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.787450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:56.790979 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.790954    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2qj6\"/\"default-dockercfg-d8lld\""
Jul 14 17:11:56.792061 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.792043    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2qj6\"/\"kube-root-ca.crt\""
Jul 14 17:11:56.792178 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.792115    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2qj6\"/\"openshift-service-ca.crt\""
Jul 14 17:11:56.802871 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.802846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"]
Jul 14 17:11:56.945750 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.945715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-lib-modules\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:56.945750 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.945752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrphf\" (UniqueName: \"kubernetes.io/projected/cdbe265a-878a-4bca-9d95-7712193a0d89-kube-api-access-qrphf\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:56.945980 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.945779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-sys\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:56.945980 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.945903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-podres\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:56.945980 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:56.945932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-proc\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.046777 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.046691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrphf\" (UniqueName: \"kubernetes.io/projected/cdbe265a-878a-4bca-9d95-7712193a0d89-kube-api-access-qrphf\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.046777 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.046743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-sys\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.046988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.046827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-podres\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.046988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.046854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-proc\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.046988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.046897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-sys\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.046988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.046914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-lib-modules\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.046988 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.046976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-proc\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.047186 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.047024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-podres\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.047186 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.047034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdbe265a-878a-4bca-9d95-7712193a0d89-lib-modules\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.058049 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.058029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrphf\" (UniqueName: \"kubernetes.io/projected/cdbe265a-878a-4bca-9d95-7712193a0d89-kube-api-access-qrphf\") pod \"perf-node-gather-daemonset-74pgl\" (UID: \"cdbe265a-878a-4bca-9d95-7712193a0d89\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.098220 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.098194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:57.232948 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.232924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"]
Jul 14 17:11:57.234909 ip-10-0-141-173 kubenswrapper[2576]: W0714 17:11:57.234883    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcdbe265a_878a_4bca_9d95_7712193a0d89.slice/crio-9a9b3c8f893a2cef692c044af7218b873d06c7ba77bd36e2879985ffc598af56 WatchSource:0}: Error finding container 9a9b3c8f893a2cef692c044af7218b873d06c7ba77bd36e2879985ffc598af56: Status 404 returned error can't find the container with id 9a9b3c8f893a2cef692c044af7218b873d06c7ba77bd36e2879985ffc598af56
Jul 14 17:11:57.996397 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.996358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl" event={"ID":"cdbe265a-878a-4bca-9d95-7712193a0d89","Type":"ContainerStarted","Data":"da5a6f8fdae0d40edce4a6c9d4b4dee2f327559a2096dc0d697033af41d68d38"}
Jul 14 17:11:57.996901 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.996418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl" event={"ID":"cdbe265a-878a-4bca-9d95-7712193a0d89","Type":"ContainerStarted","Data":"9a9b3c8f893a2cef692c044af7218b873d06c7ba77bd36e2879985ffc598af56"}
Jul 14 17:11:57.996901 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:57.996476    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:11:58.021949 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:11:58.021905    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl" podStartSLOduration=2.021891536 podStartE2EDuration="2.021891536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:11:58.020264496 +0000 UTC m=+2507.150248695" watchObservedRunningTime="2026-07-14 17:11:58.021891536 +0000 UTC m=+2507.151875737"
Jul 14 17:12:01.315494 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:01.315444    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wj6gc_b132d8c8-2160-4dd4-ae8a-8bf037850031/dns/0.log"
Jul 14 17:12:01.343847 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:01.343814    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wj6gc_b132d8c8-2160-4dd4-ae8a-8bf037850031/kube-rbac-proxy/0.log"
Jul 14 17:12:01.451808 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:01.451773    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wsnfn_f40e51cb-373d-4dbd-84e4-f5b7c7bd3131/dns-node-resolver/0.log"
Jul 14 17:12:02.162612 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:02.162581    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6nbt_54a492db-3019-4748-89d1-0a4602b62505/node-ca/0.log"
Jul 14 17:12:03.468459 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:03.468361    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-7w7b8_d30c1a98-0f07-47ef-9340-1bc3de03a68d/kube-auth-proxy/0.log"
Jul 14 17:12:03.640345 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:03.640309    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s5d2_6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4/payload-pre-processing/0.log"
Jul 14 17:12:03.722615 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:03.722524    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mgkmk_47aa168d-9295-4669-999c-a214a8d25d05/payload-processing/0.log"
Jul 14 17:12:04.011562 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:04.011536    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-74pgl"
Jul 14 17:12:04.638347 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:04.638299    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5cmwb_26f11cc4-07c7-4405-8f94-c491b5cd499a/serve-healthcheck-canary/0.log"
Jul 14 17:12:05.647241 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:05.647157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gslgw_7af01769-5d4f-4abf-9c9f-8123d4f5b03e/kube-rbac-proxy/0.log"
Jul 14 17:12:05.678130 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:05.678107    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gslgw_7af01769-5d4f-4abf-9c9f-8123d4f5b03e/exporter/0.log"
Jul 14 17:12:05.708242 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:05.708211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gslgw_7af01769-5d4f-4abf-9c9f-8123d4f5b03e/extractor/0.log"
Jul 14 17:12:07.566756 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:07.566722    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-7w7b8_d30c1a98-0f07-47ef-9340-1bc3de03a68d/kube-auth-proxy/0.log"
Jul 14 17:12:07.687975 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:07.687946    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s5d2_6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4/payload-pre-processing/0.log"
Jul 14 17:12:07.754083 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:07.754056    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mgkmk_47aa168d-9295-4669-999c-a214a8d25d05/payload-processing/0.log"
Jul 14 17:12:08.422950 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:08.422868    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d6ldf_8db53a08-7cc8-48be-a4e2-7f77dc56d12d/manager/0.log"
Jul 14 17:12:08.653398 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:08.653368    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cm7zf_2a58127c-721c-478b-8eea-1b07081782da/manager/0.log"
Jul 14 17:12:08.856899 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:08.856848    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-686f669d5d-vzwm5_fad16b8e-9d68-48b4-8565-66ac531b0d55/maas-api/0.log"
Jul 14 17:12:08.929121 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:08.929095    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734125-rttt5_ea5041b6-18a5-4f15-a28c-c95996cb02ec/cleanup/0.log"
Jul 14 17:12:08.975706 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:08.975677    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734140-6vz2g_a4770499-e47b-4d17-83f2-ad51baacad8b/cleanup/0.log"
Jul 14 17:12:09.117127 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.117051    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-7w7b8_d30c1a98-0f07-47ef-9340-1bc3de03a68d/kube-auth-proxy/0.log"
Jul 14 17:12:09.138110 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.138081    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68c8c8b776-w2kvf_832f4dc4-c5f0-4d3c-959e-97818ad91985/manager/0.log"
Jul 14 17:12:09.190753 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.190727    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z96dt_4c2548f1-2fa7-4f57-832f-51688e9d276f/server/0.log"
Jul 14 17:12:09.276753 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.276716    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s5d2_6cce9c79-7ac9-4f9f-b6ad-3f8bf66309f4/payload-pre-processing/0.log"
Jul 14 17:12:09.351727 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.351694    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rk4x6_f0b356a9-867a-42db-999f-f69c9a2b6411/manager/0.log"
Jul 14 17:12:09.368381 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.368288    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mgkmk_47aa168d-9295-4669-999c-a214a8d25d05/payload-processing/0.log"
Jul 14 17:12:09.658006 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.657908    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn_bc56f196-b2b3-43a2-bc8d-30d8ebe41019/manager/0.log"
Jul 14 17:12:09.711335 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.711308    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-pcmqn_bc56f196-b2b3-43a2-bc8d-30d8ebe41019/copy-manifests/0.log"
Jul 14 17:12:09.752670 ip-10-0-141-173 kubenswrapper[2576]: I0714 17:12:09.752639    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jh52x_b03a6cfc-f29b-4fed-91e3-2f33c0d26416/postgres/0.log"