Jul 02 21:31:09.112504 ip-10-0-131-117 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.544690    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549417    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549430    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549434    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549437    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549441    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549444    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549449    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:09.574632 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549455    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549460    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549464    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549468    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549471    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549475    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549480    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549483    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549487    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549490    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549493    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549496    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549499    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549501    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549505    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549507    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549510    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549514    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549517    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549520    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:09.576552 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549523    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549526    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549529    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549534    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549539    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549544    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549548    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549553    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549557    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549562    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549566    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549570    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549574    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549577    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549581    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549584    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549587    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549590    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549595    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549598    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:09.577186 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549601    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549604    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549607    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549610    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549613    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549616    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549618    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549621    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549624    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549627    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549630    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549633    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549636    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549639    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549642    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549645    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549647    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549650    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549653    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549656    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:09.577800 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549659    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549663    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549665    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549668    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549671    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549675    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549677    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549681    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549685    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549687    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549690    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549693    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549696    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549699    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549702    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549705    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549708    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549711    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549714    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:09.578479 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549718    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549721    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549725    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549728    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549731    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549734    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549737    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549741    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549744    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549747    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549750    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549752    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.549755    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550554    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550563    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550566    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550569    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550572    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550575    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550578    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:09.579050 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550581    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550590    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550593    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550596    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550599    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550602    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550604    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550607    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550610    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550613    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550616    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550619    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550621    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550624    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550627    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550631    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550633    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550636    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550639    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:09.579665 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550644    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550647    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550652    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550655    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550658    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550662    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550665    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550669    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550672    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550675    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550678    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550681    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550684    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550687    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550690    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550694    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550697    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550701    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550704    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550710    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:09.580228 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550713    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550716    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550718    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550721    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550724    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550727    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550730    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550733    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550736    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550738    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550741    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550744    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550747    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550750    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550752    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550755    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550758    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550761    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550764    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550767    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:09.680369 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550769    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:09.621284 ip-10-0-131-117 systemd[1]: Started Kubernetes Kubelet.
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550772    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550775    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550778    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550780    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550784    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550786    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550789    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550793    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550796    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550799    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550803    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550806    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550809    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550812    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550814    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550819    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550821    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550824    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550827    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:09.681180 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550830    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550833    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550835    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550841    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550844    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550848    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550851    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550854    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550858    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550860    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550863    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550866    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.550869    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551258    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551263    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551265    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551268    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551272    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551277    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551296    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:09.682081 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551304    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551307    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551310    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551315    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551320    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551324    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551327    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551330    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551334    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551337    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551340    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551343    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551346    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551349    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551351    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551354    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551357    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551360    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551362    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:09.682830 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551365    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551368    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551371    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551374    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551377    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551379    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551382    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551385    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551387    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551390    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551393    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551395    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551398    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551401    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551404    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551407    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551411    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551414    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551416    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551421    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:09.683520 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551423    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551428    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551431    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551433    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551436    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551439    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551442    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551444    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551447    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551451    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551455    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551458    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551461    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551464    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551467    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551470    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551473    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551476    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551478    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:09.684352 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551481    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551484    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551487    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551490    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551492    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551495    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551498    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551501    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551507    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551511    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551513    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551516    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551519    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551522    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551527    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551530    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551532    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551535    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551540    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551543    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:09.685105 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551546    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551549    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551551    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551554    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551557    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551559    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551562    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551565    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551568    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551571    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551573    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551576    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551579    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.551582    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551666    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551674    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551680    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551685    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551689    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551693    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551697    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 21:31:09.685755 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551704    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551708    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551711    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551715    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551718    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551723    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551726    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551730    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551733    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551736    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551739    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551744    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551747    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551750    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551753    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551757    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551761    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551764    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551767    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551771    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551774    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551777    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551780    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551783    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 21:31:09.686457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551786    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551791    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551794    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551798    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551800    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551804    2576 flags.go:64] FLAG: --enable-server="true"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551807    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551812    2576 flags.go:64] FLAG: --event-burst="100"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551816    2576 flags.go:64] FLAG: --event-qps="50"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551820    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551823    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551826    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551831    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551835    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551839    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551842    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551845    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551849    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551852    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551855    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551858    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551861    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551864    2576 flags.go:64] FLAG: --feature-gates=""
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551868    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551871    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 21:31:09.687181 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551874    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551878    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551881    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551884    2576 flags.go:64] FLAG: --help="false"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551887    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-131-117.ec2.internal"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551890    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551893    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551896    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551900    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551904    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551907    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551909    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551912    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551916    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551919    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551924    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551927    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551931    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551934    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551937    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551942    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551945    2576 flags.go:64] FLAG: --lock-file=""
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551948    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551952    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 21:31:09.688418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551955    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551960    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551964    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551967    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551970    2576 flags.go:64] FLAG: --logging-format="text"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551973    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551976    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551979    2576 flags.go:64] FLAG: --manifest-url=""
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551982    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551986    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551990    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.551999    2576 flags.go:64] FLAG: --max-pods="110"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552002    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552005    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552009    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552012    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552015    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552018    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552021    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552028    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552031    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552034    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552037    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 02 21:31:09.689541 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552042    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552048    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552051    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552055    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552058    2576 flags.go:64] FLAG: --port="10250"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552063    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552066    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a042edcca13c507"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552069    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552072    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552075    2576 flags.go:64] FLAG: --register-node="true"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552079    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552082    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552085    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552088    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552092    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552096    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552099    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552102    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552105    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552109    2576 flags.go:64] FLAG: --runonce="false"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552112    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552115    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552118    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552121    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552124    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552127    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 21:31:09.690818 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552130    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552133    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552137    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552139    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552142    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552145    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552148    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552153    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552156    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552161    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552164    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552169    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552174    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552177    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552180    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552183    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552186    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552189    2576 flags.go:64] FLAG: --v="2"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552193    2576 flags.go:64] FLAG: --version="false"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552198    2576 flags.go:64] FLAG: --vmodule=""
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552202    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552205    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552397    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552404    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:09.695025 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552410    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552414    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552419    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552423    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552427    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552432    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552438    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552444    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552448    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552452    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552457    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552461    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552464    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552468    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552473    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552479    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552483    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552488    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552492    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:09.696413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552498    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552502    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552506    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552510    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552514    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552518    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552521    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552524    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552527    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552531    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552535    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552540    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552544    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552549    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552553    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552557    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552561    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552565    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552569    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552573    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:09.852773 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552577    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552581    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552585    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552589    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552593    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552598    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552602    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552606    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552613    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552617    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552621    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552625    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552631    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552635    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552639    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552644    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552650    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552655    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552660    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552665    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:09.876229 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552670    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552675    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552679    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552684    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552688    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552692    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552696    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552701    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552705    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552709    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552713    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552716    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552720    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552724    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552728    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552732    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552736    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552740    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552744    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552747    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:09.876925 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552752    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552756    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552760    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552764    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552769    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552773    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552778    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552784    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552790    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552795    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552799    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552803    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552807    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552811    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552815    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552819    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552823    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:09.877613 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.552827    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.552835    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.561547    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.561567    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.562437    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.562590    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562659    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562665    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562669    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562672    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562675    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562680    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562685    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562688    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:09.878124 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562692    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562695    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562698    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562701    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562704    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562707    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562710    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562713    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562716    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562720    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562723    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562726    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562729    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562731    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562734    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562737    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562740    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562743    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562745    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562748    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:09.878625 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562751    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562759    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562762    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562764    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562768    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562771    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562774    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562777    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562780    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562783    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562786    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562789    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562792    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562795    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562798    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562801    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562804    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562806    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562809    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562812    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:09.879221 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562815    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562820    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562824    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562830    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562833    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562836    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562839    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562842    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562845    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562849    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562853    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562856    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562859    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562862    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562865    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562867    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562871    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562873    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562876    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:09.879866 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562879    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562883    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562885    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562888    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562891    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562894    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562897    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562900    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562902    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562905    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562908    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562911    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562914    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562917    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562920    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562923    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562928    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562931    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562934    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562937    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:09.880451 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562940    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562942    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562945    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562948    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562951    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562954    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562957    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562960    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562962    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562965    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562969    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.562971    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.562977    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563101    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563106    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:09.881100 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563109    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563113    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563116    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563119    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563122    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563126    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563129    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563132    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563135    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563137    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563140    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563143    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563146    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563155    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563159    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563162    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563165    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563168    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563170    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563173    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:09.881596 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563176    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563179    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563182    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563185    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563187    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563190    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563193    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563196    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563199    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563202    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563205    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563208    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563210    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563213    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563216    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563219    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563222    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563224    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563227    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563230    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:09.882587 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563232    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563235    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563238    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563243    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563245    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563249    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563253    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563256    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563259    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563262    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563265    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563267    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563270    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563273    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563277    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563299    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563303    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563306    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563309    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:09.883289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563312    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563315    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563318    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563321    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563324    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563327    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563330    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563332    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563335    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563338    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563340    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563343    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563346    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563349    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563352    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563354    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563357    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563361    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563366    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:09.883965 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563371    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563375    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563378    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563381    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563385    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563388    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563392    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563395    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563399    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563402    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563405    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563409    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563412    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563415    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563418    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563420    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563423    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563426    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:09.884640 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:09.563429    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.563434    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.563549    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.566789    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.568462    2576 server.go:1019] "Starting client certificate rotation"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.568568    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.568600    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.574190    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.579318    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.585371    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.589612    2576 log.go:25] "Validated CRI v1 image API"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.590411    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 21:31:09.885318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.593173    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94d6e45f-38f4-4c50-b1ef-d130b9577b2b:/dev/nvme0n1p4 a4505f92-b9bb-4ab3-8e0d-a7f3902273ed:/dev/nvme0n1p3]
Jul 02 21:31:09.885757 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.593191    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.598194    2576 manager.go:216] Machine: {Timestamp:2026-07-02 21:31:09.597666017 +0000 UTC m=+0.361197132 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119614 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4e5fac84edb78b8d8dab8c966468 SystemUUID:ec2a4e5f-ac84-edb7-8b8d-8dab8c966468 BootID:45ab235b-a6ae-4c3a-b38e-6d3e15c370dd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:eb:f6:53:67:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:eb:f6:53:67:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:42:7d:88:72:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.598383    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.598508    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.600869    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.600893    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.601563    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.601574    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 21:31:09.885986 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.601582    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.602073    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.604025    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.605102    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607008    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607152    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607183    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607193    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607209    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607220    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607232    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607791    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.607827    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.612627    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.614771    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.614801    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.615961    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.615975    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.615981    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.615988    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.615997    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616003    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616012    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616021    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616031    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616037    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616050    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616056    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.616988    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.617005    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.617661    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.617661    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.620391    2576 server.go:1268] "Started kubelet"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.620997    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.621077    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.621102    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.622888    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.623291    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.626598    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 21:31:09.886680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.627112    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.627114    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-117.ec2.internal.18be96668957ddf3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-117.ec2.internal,UID:ip-10-0-131-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-117.ec2.internal,},FirstTimestamp:2026-07-02 21:31:09.620362739 +0000 UTC m=+0.383893852,LastTimestamp:2026-07-02 21:31:09.620362739 +0000 UTC m=+0.383893852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-117.ec2.internal,}"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.628745    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.628759    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.628866    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629375    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629380    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629393    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629528    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629538    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629714    2576 factory.go:55] Registering systemd factory
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629727    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629961    2576 factory.go:153] Registering CRI-O factory
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.629973    2576 factory.go:223] Registration of the crio container factory successfully
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.630037    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.630055    2576 factory.go:103] Registering Raw factory
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.630066    2576 manager.go:1196] Started watching for new ooms in manager
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.630473    2576 manager.go:349] Starting recovery of all containers
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.635066    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.635168    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.636226    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fj7bm"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.647475    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fj7bm"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.650232    2576 manager.go:354] Recovery completed
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.655969    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.662543    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.662573    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.662583    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.663253    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.663262    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.663279    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.663297    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.664068    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:09.888011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.664093    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.664103    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.664758    2576 policy_none.go:49] "None policy: Start"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.664770    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.664781    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.665758    2576 policy_none.go:47] "Start"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.666069    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-117.ec2.internal.18be96668bdbb7ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-117.ec2.internal,UID:ip-10-0-131-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-117.ec2.internal,},FirstTimestamp:2026-07-02 21:31:09.662558191 +0000 UTC m=+0.426089304,LastTimestamp:2026-07-02 21:31:09.662558191 +0000 UTC m=+0.426089304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-117.ec2.internal,}"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.711896    2576 manager.go:337] "Starting Device Plugin manager"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.712138    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.712150    2576 server.go:87] "Starting device plugin registration server"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.712420    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.712430    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.712565    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.712662    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.712674    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.713288    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.713354    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.813186    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.814342    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.814381    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.814396    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.814432    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-117.ec2.internal"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.819893    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.821242    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.821306    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.821339    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.821381    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.823706    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-117.ec2.internal"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.823726    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-117.ec2.internal\": node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.823778    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:09.889233 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.876628    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.924310    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"]
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.924398    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.927638    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.927670    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.927686    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.929420    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.929553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.929582    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.930586    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.930616    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.930628    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.930586    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.930708    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.930727    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.932662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.932689    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.933555    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.933583    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.933597    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.935370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.935413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:09.935494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0caf382ca9eb296da259b7ea66c7880a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"0caf382ca9eb296da259b7ea66c7880a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.971307    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.976379    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.008569 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:09.977930    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.152151 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.036497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.152151 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.036524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.152151 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.036551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0caf382ca9eb296da259b7ea66c7880a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"0caf382ca9eb296da259b7ea66c7880a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.152151 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.036603    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.152151 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.036684    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0caf382ca9eb296da259b7ea66c7880a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"0caf382ca9eb296da259b7ea66c7880a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.152151 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.036719    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.152151 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:10.078989    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.298245 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:10.182589    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.298245 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.276090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.298245 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.278922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.298245 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:10.283637    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.509196 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:10.383696    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.509196 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:10.484353    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.569109    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.569311    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:10.584887    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.652666    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 21:26:10 +0000 UTC" deadline="2028-01-06 17:15:55.157675294 +0000 UTC"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.652708    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13267h44m44.504971053s"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.671405    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.715210    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:10.729571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.729279    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.871674 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.741160    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 21:31:10.871674 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.743189    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 02 21:31:10.871674 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.753649    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 21:31:10.871674 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.809456    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:11.084692 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:10.953796    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1375989dc36f18a986154f7263a01ba9.slice/crio-3438e7dcbb3c889e34e39b04888a08410ca778cb36b2b1650ad479252b875f89 WatchSource:0}: Error finding container 3438e7dcbb3c889e34e39b04888a08410ca778cb36b2b1650ad479252b875f89: Status 404 returned error can't find the container with id 3438e7dcbb3c889e34e39b04888a08410ca778cb36b2b1650ad479252b875f89
Jul 02 21:31:11.084692 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:10.955408    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0caf382ca9eb296da259b7ea66c7880a.slice/crio-6106d0c5ae64f717c43a2675e8dbe2dcf95a87373f0a6414eaf4d848f3a3a4bf WatchSource:0}: Error finding container 6106d0c5ae64f717c43a2675e8dbe2dcf95a87373f0a6414eaf4d848f3a3a4bf: Status 404 returned error can't find the container with id 6106d0c5ae64f717c43a2675e8dbe2dcf95a87373f0a6414eaf4d848f3a3a4bf
Jul 02 21:31:11.084692 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:10.958820    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:31:11.586807 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.550408    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:11.609285 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.609260    2576 apiserver.go:52] "Watching apiserver"
Jul 02 21:31:11.620809 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.620784    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 21:31:11.622356 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.622319    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-7b9m9","openshift-multus/network-metrics-daemon-5brlj","openshift-network-diagnostics/network-check-target-vvzjb","kube-system/global-pull-secret-syncer-cghb6","kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cgdzp","openshift-dns/node-resolver-m9hbb","openshift-image-registry/node-ca-lbfjz","openshift-multus/multus-vdjtc","openshift-network-operator/iptables-alerter-v2k7m","openshift-ovn-kubernetes/ovnkube-node-cqqqj","kube-system/konnectivity-agent-5zr5v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"]
Jul 02 21:31:11.624287 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.624074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.625450 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.625423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.627049 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.626928    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fml4l\""
Jul 02 21:31:11.627256 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.627235    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 21:31:11.627736 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.627301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:11.627736 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.627313    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 21:31:11.627736 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.627522    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:11.628300 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.628095    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jzdgc\""
Jul 02 21:31:11.628300 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.628139    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 21:31:11.628300 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.628148    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 21:31:11.629657 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.629133    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 21:31:11.629657 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.629218    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 21:31:11.629657 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.629389    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 21:31:11.629657 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.629443    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 21:31:11.629657 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.629496    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 21:31:11.631463 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.631240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.631463 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.631308    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:11.633413 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.633274    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.634903 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.634882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.635558 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.635529    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jtq2t\""
Jul 02 21:31:11.635558 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.635539    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 21:31:11.635700 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.635590    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 21:31:11.635700 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.635667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 21:31:11.637723 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.637673    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:31:11.637852 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.637819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5tv9r\""
Jul 02 21:31:11.638429 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.637993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.638429 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.638192    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 21:31:11.639766 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.639749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.640731 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.640713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:11.640839 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.640780    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:11.640993 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.640929    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 21:31:11.641102 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.641083    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 21:31:11.642108 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.641771    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 21:31:11.642589 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.642572    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pphch\""
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.645113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.643921    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.643985    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.645876    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.644125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dbzhs\""
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.644190    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.644660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.643295    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.646612    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.646956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.646987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddkkk\" (UniqueName: \"kubernetes.io/projected/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-kube-api-access-ddkkk\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-run-netns\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-systemd\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-etc-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovnkube-config\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-env-overrides\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.648109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-ovn\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovn-node-metrics-cert\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovnkube-script-lib\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-tmp-dir\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb9b5ee3-6870-45f9-9998-33e9ce83e284-dbus\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgvlv\" (UniqueName: \"kubernetes.io/projected/c87a09d1-22d3-495a-93d6-fbf38c83626f-kube-api-access-tgvlv\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-cni-netd\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-systemd-units\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-slash\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-log-socket\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-cni-bin\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:11.649096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.649769 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb9b5ee3-6870-45f9-9998-33e9ce83e284-kubelet-config\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.649769 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-hosts-file\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.649769 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-kubelet\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649769 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-var-lib-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.649769 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.647719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-node-log\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.651349 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.650884    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 21:31:11.651349 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.651124    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dxrws\""
Jul 02 21:31:11.651349 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.651143    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4tpdp\""
Jul 02 21:31:11.651547 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.651405    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:31:11.651547 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.651489    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 21:31:11.653572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.651924    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 21:31:11.653572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.651956    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xbvgf\""
Jul 02 21:31:11.653572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.652117    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 21:31:11.653572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.652157    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 21:31:11.653572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.652372    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 21:31:11.669617 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.669594    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6v249"
Jul 02 21:31:11.671246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.670861    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6v249"
Jul 02 21:31:11.731136 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.731104    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 21:31:11.748222 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.748222 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgvlv\" (UniqueName: \"kubernetes.io/projected/c87a09d1-22d3-495a-93d6-fbf38c83626f-kube-api-access-tgvlv\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.748418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-cnibin\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.748418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-os-release\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.748418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-daemon-config\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.748418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-etc-kubernetes\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.748418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-socket-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.748418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-cni-binary-copy\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x8bj\" (UniqueName: \"kubernetes.io/projected/21be25c2-8baf-4144-9569-3bff04f3b515-kube-api-access-5x8bj\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-k8s-cni-cncf-io\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-registration-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-device-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvbpn\" (UniqueName: \"kubernetes.io/projected/bd8a614c-3357-407d-9e96-3d4c62ac3652-kube-api-access-cvbpn\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-slash\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-cni-bin\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:11.748695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb9b5ee3-6870-45f9-9998-33e9ce83e284-kubelet-config\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-slash\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-kubelet\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748768    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-kubelet\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-var-lib-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748824    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-cni-bin\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c8e3666-51cb-4bf8-a213-70955f980526-konnectivity-ca\") pod \"konnectivity-agent-5zr5v\" (UID: \"2c8e3666-51cb-4bf8-a213-70955f980526\") " pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bffaf14-d6f2-422c-8fab-b77bdea1460f-serviceca\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748871    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-modprobe-d\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysctl-conf\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-run-netns\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-etc-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.748995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovnkube-config\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgdjz\" (UniqueName: \"kubernetes.io/projected/2c71f14d-4178-48a4-a229-16e98c2fe8ba-kube-api-access-rgdjz\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysconfig\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-lib-modules\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbwr\" (UniqueName: \"kubernetes.io/projected/e18bdcde-c266-45b9-982b-138d88cb71dc-kube-api-access-jvbwr\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-ovn\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749174    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb9b5ee3-6870-45f9-9998-33e9ce83e284-kubelet-config\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-netns\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749229    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-var-lib-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-run\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749276    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-etc-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749346    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-run-netns\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-ovn\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.749922 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749388    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5djd\" (UniqueName: \"kubernetes.io/projected/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-kube-api-access-j5djd\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e18bdcde-c266-45b9-982b-138d88cb71dc-iptables-alerter-script\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-tmp-dir\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb9b5ee3-6870-45f9-9998-33e9ce83e284-dbus\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e18bdcde-c266-45b9-982b-138d88cb71dc-host-slash\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-system-cni-dir\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-cni-netd\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-system-cni-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-cni-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749788    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb9b5ee3-6870-45f9-9998-33e9ce83e284-dbus\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bffaf14-d6f2-422c-8fab-b77bdea1460f-host\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.750683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-tmp-dir\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-tmp\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749888    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-host-cni-netd\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62trl\" (UniqueName: \"kubernetes.io/projected/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-kube-api-access-62trl\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.749974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-systemd-units\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-log-socket\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750011    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovnkube-config\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750044    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-log-socket\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-kubelet\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.750181    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.750290    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret podName:cb9b5ee3-6870-45f9-9998-33e9ce83e284 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:12.250253895 +0000 UTC m=+3.013785016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret") pod "global-pull-secret-syncer-cghb6" (UID: "cb9b5ee3-6870-45f9-9998-33e9ce83e284") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750279    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-systemd-units\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.751345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-kubernetes\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-hosts-file\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-node-log\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-socket-dir-parent\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-cni-multus\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-hostroot\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysctl-d\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-host\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750504    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-node-log\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-conf-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-multus-certs\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddkkk\" (UniqueName: \"kubernetes.io/projected/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-kube-api-access-ddkkk\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-systemd\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-hosts-file\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752084 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-cni-binary-copy\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-systemd\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-cnibin\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-env-overrides\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-sys-fs\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c8e3666-51cb-4bf8-a213-70955f980526-agent-certs\") pod \"konnectivity-agent-5zr5v\" (UID: \"2c8e3666-51cb-4bf8-a213-70955f980526\") " pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-systemd\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-tuned\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovn-node-metrics-cert\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750892    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c87a09d1-22d3-495a-93d6-fbf38c83626f-run-openvswitch\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovnkube-script-lib\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-cni-bin\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.750997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-sys\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.751021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-var-lib-kubelet\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.752834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.751046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlxnk\" (UniqueName: \"kubernetes.io/projected/4bffaf14-d6f2-422c-8fab-b77bdea1460f-kube-api-access-vlxnk\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.753570 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.751130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-os-release\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.753570 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.751232    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 21:31:11.753570 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.751595    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-env-overrides\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.753570 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.752035    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovnkube-script-lib\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.754652 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.754632    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:11.754747 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.754660    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:11.754747 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.754674    2576 projected.go:196] Error preparing data for projected volume kube-api-access-wmn75 for pod openshift-network-diagnostics/network-check-target-vvzjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:11.754747 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.754745    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75 podName:21a6a7c5-fd48-494d-8a96-8e52cdd9abcd nodeName:}" failed. No retries permitted until 2026-07-02 21:31:12.254710588 +0000 UTC m=+3.018241693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wmn75" (UniqueName: "kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75") pod "network-check-target-vvzjb" (UID: "21a6a7c5-fd48-494d-8a96-8e52cdd9abcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:11.757252 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.757194    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c87a09d1-22d3-495a-93d6-fbf38c83626f-ovn-node-metrics-cert\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.759024 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.758924    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgvlv\" (UniqueName: \"kubernetes.io/projected/c87a09d1-22d3-495a-93d6-fbf38c83626f-kube-api-access-tgvlv\") pod \"ovnkube-node-cqqqj\" (UID: \"c87a09d1-22d3-495a-93d6-fbf38c83626f\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.760979 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.760887    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddkkk\" (UniqueName: \"kubernetes.io/projected/8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2-kube-api-access-ddkkk\") pod \"node-resolver-m9hbb\" (UID: \"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2\") " pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.828876 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.828785    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" event={"ID":"0caf382ca9eb296da259b7ea66c7880a","Type":"ContainerStarted","Data":"6106d0c5ae64f717c43a2675e8dbe2dcf95a87373f0a6414eaf4d848f3a3a4bf"}
Jul 02 21:31:11.831045 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.831014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"1375989dc36f18a986154f7263a01ba9","Type":"ContainerStarted","Data":"3438e7dcbb3c889e34e39b04888a08410ca778cb36b2b1650ad479252b875f89"}
Jul 02 21:31:11.851474 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-lib-modules\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.851618 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbwr\" (UniqueName: \"kubernetes.io/projected/e18bdcde-c266-45b9-982b-138d88cb71dc-kube-api-access-jvbwr\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.851618 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-netns\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.851618 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-run\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.851618 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5djd\" (UniqueName: \"kubernetes.io/projected/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-kube-api-access-j5djd\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.851618 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e18bdcde-c266-45b9-982b-138d88cb71dc-iptables-alerter-script\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.851799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.851799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e18bdcde-c266-45b9-982b-138d88cb71dc-host-slash\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.851799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.851799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851683    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-lib-modules\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.851799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-system-cni-dir\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.851799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-system-cni-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.851799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-cni-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bffaf14-d6f2-422c-8fab-b77bdea1460f-host\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-tmp\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62trl\" (UniqueName: \"kubernetes.io/projected/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-kube-api-access-62trl\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-run\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-kubelet\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851970    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-netns\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.851972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-kubernetes\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-socket-dir-parent\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852033    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-kubernetes\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-cni-multus\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-hostroot\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysctl-d\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-host\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852150    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-conf-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-multus-certs\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852189    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-conf-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-cni-binary-copy\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-systemd\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852276    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-system-cni-dir\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-cnibin\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-sys-fs\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852382    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e18bdcde-c266-45b9-982b-138d88cb71dc-iptables-alerter-script\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852388    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-socket-dir-parent\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c8e3666-51cb-4bf8-a213-70955f980526-agent-certs\") pod \"konnectivity-agent-5zr5v\" (UID: \"2c8e3666-51cb-4bf8-a213-70955f980526\") " pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-tuned\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852329    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-cnibin\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852511    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-host\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852570    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-cni-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e18bdcde-c266-45b9-982b-138d88cb71dc-host-slash\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852643    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-cni-multus\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.852763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852678    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-hostroot\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-cni-bin\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-sys\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.853005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-var-lib-kubelet\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.853035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlxnk\" (UniqueName: \"kubernetes.io/projected/4bffaf14-d6f2-422c-8fab-b77bdea1460f-kube-api-access-vlxnk\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.853034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.852945    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-systemd\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.853056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-multus-certs\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.853063    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysctl-d\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.853472 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.853219    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-cni-binary-copy\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.853834 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.853760    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-cni-bin\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.854303    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.854464    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-sys\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.854585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-var-lib-kubelet\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.854836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-os-release\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-var-lib-kubelet\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855144    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-system-cni-dir\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bffaf14-d6f2-422c-8fab-b77bdea1460f-host\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-cnibin\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-os-release\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.855639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-daemon-config\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-etc-kubernetes\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-socket-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-cni-binary-copy\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x8bj\" (UniqueName: \"kubernetes.io/projected/21be25c2-8baf-4144-9569-3bff04f3b515-kube-api-access-5x8bj\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-os-release\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-k8s-cni-cncf-io\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-registration-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855942    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21be25c2-8baf-4144-9569-3bff04f3b515-os-release\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.855955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-device-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-device-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbpn\" (UniqueName: \"kubernetes.io/projected/bd8a614c-3357-407d-9e96-3d4c62ac3652-kube-api-access-cvbpn\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c8e3666-51cb-4bf8-a213-70955f980526-konnectivity-ca\") pod \"konnectivity-agent-5zr5v\" (UID: \"2c8e3666-51cb-4bf8-a213-70955f980526\") " pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:11.856268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bffaf14-d6f2-422c-8fab-b77bdea1460f-serviceca\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.856742 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-modprobe-d\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.856742 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysctl-conf\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.856742 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.856742 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgdjz\" (UniqueName: \"kubernetes.io/projected/2c71f14d-4178-48a4-a229-16e98c2fe8ba-kube-api-access-rgdjz\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:11.856742 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysconfig\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.856742 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856620    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.856742 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysconfig\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.856945 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856784    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-cnibin\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.856945 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.856833    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-sys-fs\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.857030 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.857012    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-tuned\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.857234 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.857218    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-multus-daemon-config\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.857270 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.857240    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-host-run-k8s-cni-cncf-io\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.857398 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.857378    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-registration-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.857446 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.857396    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:11.857533 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.857515    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-modprobe-d\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.857620 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.857601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21be25c2-8baf-4144-9569-3bff04f3b515-cni-binary-copy\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.857950 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.857928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-etc-kubernetes\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.858034 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.858015    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.858096 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.858053    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd8a614c-3357-407d-9e96-3d4c62ac3652-socket-dir\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.858166 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:11.858149    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:31:12.358124512 +0000 UTC m=+3.121655626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:11.858234 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.858176    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-etc-sysctl-conf\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.858534 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.858513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bffaf14-d6f2-422c-8fab-b77bdea1460f-serviceca\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.858680 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.858658    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c8e3666-51cb-4bf8-a213-70955f980526-agent-certs\") pod \"konnectivity-agent-5zr5v\" (UID: \"2c8e3666-51cb-4bf8-a213-70955f980526\") " pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:11.859959 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.859933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c8e3666-51cb-4bf8-a213-70955f980526-konnectivity-ca\") pod \"konnectivity-agent-5zr5v\" (UID: \"2c8e3666-51cb-4bf8-a213-70955f980526\") " pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:11.862448 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.862060    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-tmp\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.863606 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.863565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5djd\" (UniqueName: \"kubernetes.io/projected/3069c2f7-c164-4f24-bed1-d0a10fa4ca3b-kube-api-access-j5djd\") pod \"tuned-cgdzp\" (UID: \"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b\") " pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.865814 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.865777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlxnk\" (UniqueName: \"kubernetes.io/projected/4bffaf14-d6f2-422c-8fab-b77bdea1460f-kube-api-access-vlxnk\") pod \"node-ca-lbfjz\" (UID: \"4bffaf14-d6f2-422c-8fab-b77bdea1460f\") " pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.865814 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.865803    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbwr\" (UniqueName: \"kubernetes.io/projected/e18bdcde-c266-45b9-982b-138d88cb71dc-kube-api-access-jvbwr\") pod \"iptables-alerter-v2k7m\" (UID: \"e18bdcde-c266-45b9-982b-138d88cb71dc\") " pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:11.868177 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.868020    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62trl\" (UniqueName: \"kubernetes.io/projected/7d91e315-8f33-467a-ae0e-7dafc94c0c1b-kube-api-access-62trl\") pod \"multus-vdjtc\" (UID: \"7d91e315-8f33-467a-ae0e-7dafc94c0c1b\") " pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.869141 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.869092    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbpn\" (UniqueName: \"kubernetes.io/projected/bd8a614c-3357-407d-9e96-3d4c62ac3652-kube-api-access-cvbpn\") pod \"aws-ebs-csi-driver-node-8wmk5\" (UID: \"bd8a614c-3357-407d-9e96-3d4c62ac3652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.872627 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.872601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgdjz\" (UniqueName: \"kubernetes.io/projected/2c71f14d-4178-48a4-a229-16e98c2fe8ba-kube-api-access-rgdjz\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:11.875627 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.875582    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x8bj\" (UniqueName: \"kubernetes.io/projected/21be25c2-8baf-4144-9569-3bff04f3b515-kube-api-access-5x8bj\") pod \"multus-additional-cni-plugins-7b9m9\" (UID: \"21be25c2-8baf-4144-9569-3bff04f3b515\") " pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.939056 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.939021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m9hbb"
Jul 02 21:31:11.949414 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.949182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:11.954929 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:11.954895    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f69a6f0_de6f_4fe0_9a3d_a2ac461195b2.slice/crio-e5dde8d9de2180b425a5f51ccf608cfca6905b655334e6971bb026a093026209 WatchSource:0}: Error finding container e5dde8d9de2180b425a5f51ccf608cfca6905b655334e6971bb026a093026209: Status 404 returned error can't find the container with id e5dde8d9de2180b425a5f51ccf608cfca6905b655334e6971bb026a093026209
Jul 02 21:31:11.959627 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.959451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lbfjz"
Jul 02 21:31:11.961413 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:11.961378    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87a09d1_22d3_495a_93d6_fbf38c83626f.slice/crio-9311983386ca0c7d3fabfb16da24eef0bf5a7e8812f4e0f8b4e39a8f10d123b6 WatchSource:0}: Error finding container 9311983386ca0c7d3fabfb16da24eef0bf5a7e8812f4e0f8b4e39a8f10d123b6: Status 404 returned error can't find the container with id 9311983386ca0c7d3fabfb16da24eef0bf5a7e8812f4e0f8b4e39a8f10d123b6
Jul 02 21:31:11.968270 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.968068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cgdzp"
Jul 02 21:31:11.973077 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:11.973050    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bffaf14_d6f2_422c_8fab_b77bdea1460f.slice/crio-5ef091a5ab5408e6507c6babf6ae79b752898cc73063afe3bad3b432b8e4f220 WatchSource:0}: Error finding container 5ef091a5ab5408e6507c6babf6ae79b752898cc73063afe3bad3b432b8e4f220: Status 404 returned error can't find the container with id 5ef091a5ab5408e6507c6babf6ae79b752898cc73063afe3bad3b432b8e4f220
Jul 02 21:31:11.978851 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.978827    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdjtc"
Jul 02 21:31:11.988712 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.988524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5"
Jul 02 21:31:11.996580 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:11.996409    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7b9m9"
Jul 02 21:31:11.999383 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:11.999333    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8a614c_3357_407d_9e96_3d4c62ac3652.slice/crio-fa949c29e1dda5e93bed89add32276fb46c2845c88ff474e8603573361079a75 WatchSource:0}: Error finding container fa949c29e1dda5e93bed89add32276fb46c2845c88ff474e8603573361079a75: Status 404 returned error can't find the container with id fa949c29e1dda5e93bed89add32276fb46c2845c88ff474e8603573361079a75
Jul 02 21:31:12.008394 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.008368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v2k7m"
Jul 02 21:31:12.016053 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.016027    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:12.019662 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:12.019633    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18bdcde_c266_45b9_982b_138d88cb71dc.slice/crio-e38532cda507aa751f361e407f796688c64e0c5b1395c240ab864ddcbc64255e WatchSource:0}: Error finding container e38532cda507aa751f361e407f796688c64e0c5b1395c240ab864ddcbc64255e: Status 404 returned error can't find the container with id e38532cda507aa751f361e407f796688c64e0c5b1395c240ab864ddcbc64255e
Jul 02 21:31:12.025926 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:12.025899    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8e3666_51cb_4bf8_a213_70955f980526.slice/crio-c5ed95454f93b3b6b155e6bc31b5546272d32abc197779848bc0e0122df1cf49 WatchSource:0}: Error finding container c5ed95454f93b3b6b155e6bc31b5546272d32abc197779848bc0e0122df1cf49: Status 404 returned error can't find the container with id c5ed95454f93b3b6b155e6bc31b5546272d32abc197779848bc0e0122df1cf49
Jul 02 21:31:12.260590 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.260495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:12.260590 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.260565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:12.260820 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.260718    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:12.260820 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.260741    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:12.260820 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.260756    2576 projected.go:196] Error preparing data for projected volume kube-api-access-wmn75 for pod openshift-network-diagnostics/network-check-target-vvzjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:12.260820 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.260791    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:12.260820 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.260820    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75 podName:21a6a7c5-fd48-494d-8a96-8e52cdd9abcd nodeName:}" failed. No retries permitted until 2026-07-02 21:31:13.260800419 +0000 UTC m=+4.024331539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmn75" (UniqueName: "kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75") pod "network-check-target-vvzjb" (UID: "21a6a7c5-fd48-494d-8a96-8e52cdd9abcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:12.261098 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.260841    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret podName:cb9b5ee3-6870-45f9-9998-33e9ce83e284 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:13.260828363 +0000 UTC m=+4.024359468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret") pod "global-pull-secret-syncer-cghb6" (UID: "cb9b5ee3-6870-45f9-9998-33e9ce83e284") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:12.361815 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.361752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:12.362012 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.361895    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:12.362012 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.361980    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:31:13.361962271 +0000 UTC m=+4.125493371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:12.673718 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.673622    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:26:11 +0000 UTC" deadline="2028-04-12 22:14:09.002833558 +0000 UTC"
Jul 02 21:31:12.673718 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.673667    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15600h42m56.329170732s"
Jul 02 21:31:12.822183 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.822145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:12.822933 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.822311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:12.822933 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.822503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:12.822933 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:12.822659    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:12.834544 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.834507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5zr5v" event={"ID":"2c8e3666-51cb-4bf8-a213-70955f980526","Type":"ContainerStarted","Data":"c5ed95454f93b3b6b155e6bc31b5546272d32abc197779848bc0e0122df1cf49"}
Jul 02 21:31:12.836167 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.836138    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5" event={"ID":"bd8a614c-3357-407d-9e96-3d4c62ac3652","Type":"ContainerStarted","Data":"fa949c29e1dda5e93bed89add32276fb46c2845c88ff474e8603573361079a75"}
Jul 02 21:31:12.837523 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.837474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdjtc" event={"ID":"7d91e315-8f33-467a-ae0e-7dafc94c0c1b","Type":"ContainerStarted","Data":"367cacb41b72a5ecd67f8614bb85765b013f6668afa6121faf946ed4594bda0d"}
Jul 02 21:31:12.838775 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.838724    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cgdzp" event={"ID":"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b","Type":"ContainerStarted","Data":"577a1d2bf098a8ba5f8153401b352922636c13124739cb4b661676f8526c795a"}
Jul 02 21:31:12.840046 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.840018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lbfjz" event={"ID":"4bffaf14-d6f2-422c-8fab-b77bdea1460f","Type":"ContainerStarted","Data":"5ef091a5ab5408e6507c6babf6ae79b752898cc73063afe3bad3b432b8e4f220"}
Jul 02 21:31:12.841360 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.841330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m9hbb" event={"ID":"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2","Type":"ContainerStarted","Data":"e5dde8d9de2180b425a5f51ccf608cfca6905b655334e6971bb026a093026209"}
Jul 02 21:31:12.842702 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.842668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v2k7m" event={"ID":"e18bdcde-c266-45b9-982b-138d88cb71dc","Type":"ContainerStarted","Data":"e38532cda507aa751f361e407f796688c64e0c5b1395c240ab864ddcbc64255e"}
Jul 02 21:31:12.843978 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.843956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerStarted","Data":"b8d00bdaa2e6c1690d62079071c881586b350061e5a33279fbb9d622f4be5394"}
Jul 02 21:31:12.845429 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:12.845401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"9311983386ca0c7d3fabfb16da24eef0bf5a7e8812f4e0f8b4e39a8f10d123b6"}
Jul 02 21:31:13.269871 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:13.269780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:13.270054 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:13.269876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:13.270054 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.270008    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:13.270173 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.270078    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret podName:cb9b5ee3-6870-45f9-9998-33e9ce83e284 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:15.27005671 +0000 UTC m=+6.033587813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret") pod "global-pull-secret-syncer-cghb6" (UID: "cb9b5ee3-6870-45f9-9998-33e9ce83e284") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:13.270251 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.270173    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:13.270251 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.270191    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:13.270251 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.270206    2576 projected.go:196] Error preparing data for projected volume kube-api-access-wmn75 for pod openshift-network-diagnostics/network-check-target-vvzjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:13.270434 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.270256    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75 podName:21a6a7c5-fd48-494d-8a96-8e52cdd9abcd nodeName:}" failed. No retries permitted until 2026-07-02 21:31:15.270242781 +0000 UTC m=+6.033773883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmn75" (UniqueName: "kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75") pod "network-check-target-vvzjb" (UID: "21a6a7c5-fd48-494d-8a96-8e52cdd9abcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:13.370640 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:13.370597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:13.370841 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.370783    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:13.370918 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.370854    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:31:15.370833082 +0000 UTC m=+6.134364184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:13.674341 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:13.674297    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:26:11 +0000 UTC" deadline="2028-04-13 18:24:41.01031503 +0000 UTC"
Jul 02 21:31:13.674341 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:13.674338    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15620h53m27.335981639s"
Jul 02 21:31:13.831223 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:13.831192    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:13.831706 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:13.831532    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:14.821767 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:14.821734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:14.821954 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:14.821878    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:14.822337 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:14.822315    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:14.822442 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:14.822421    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:15.287736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:15.287843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.287992    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.288013    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.288026    2576 projected.go:196] Error preparing data for projected volume kube-api-access-wmn75 for pod openshift-network-diagnostics/network-check-target-vvzjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.288087    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75 podName:21a6a7c5-fd48-494d-8a96-8e52cdd9abcd nodeName:}" failed. No retries permitted until 2026-07-02 21:31:19.288067633 +0000 UTC m=+10.051598757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmn75" (UniqueName: "kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75") pod "network-check-target-vvzjb" (UID: "21a6a7c5-fd48-494d-8a96-8e52cdd9abcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.288294    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:15.288367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.288365    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret podName:cb9b5ee3-6870-45f9-9998-33e9ce83e284 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:19.28834511 +0000 UTC m=+10.051876210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret") pod "global-pull-secret-syncer-cghb6" (UID: "cb9b5ee3-6870-45f9-9998-33e9ce83e284") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:15.389111 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:15.388447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:15.389111 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.388655    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:15.389111 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.388719    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:31:19.388701531 +0000 UTC m=+10.152232634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:15.821665 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:15.821629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:15.821886 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:15.821859    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:16.822295 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:16.822262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:16.822759 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:16.822262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:16.822759 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:16.822394    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:16.822759 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:16.822418    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:17.821604 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:17.821512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:17.821762 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:17.821643    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:18.822150 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:18.822110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:18.822630 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:18.822265    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:18.822630 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:18.822321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:18.822630 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:18.822418    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:19.324401 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:19.324363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:19.324596 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:19.324452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:19.324664 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.324597    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:19.324664 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.324618    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:19.324664 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.324632    2576 projected.go:196] Error preparing data for projected volume kube-api-access-wmn75 for pod openshift-network-diagnostics/network-check-target-vvzjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:19.324803 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.324694    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75 podName:21a6a7c5-fd48-494d-8a96-8e52cdd9abcd nodeName:}" failed. No retries permitted until 2026-07-02 21:31:27.324672898 +0000 UTC m=+18.088204010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmn75" (UniqueName: "kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75") pod "network-check-target-vvzjb" (UID: "21a6a7c5-fd48-494d-8a96-8e52cdd9abcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:19.325028 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.324965    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:19.325155 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.325041    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret podName:cb9b5ee3-6870-45f9-9998-33e9ce83e284 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:27.325024478 +0000 UTC m=+18.088555603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret") pod "global-pull-secret-syncer-cghb6" (UID: "cb9b5ee3-6870-45f9-9998-33e9ce83e284") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:19.425799 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:19.425743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:19.425992 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.425915    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:19.426043 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.426000    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:31:27.425979004 +0000 UTC m=+18.189510121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:19.826802 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:19.826313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:19.826802 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:19.826447    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:20.822093 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:20.822054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:20.822093 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:20.822073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:20.822336 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:20.822188    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:20.822406 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:20.822372    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:21.824796 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:21.824767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:21.825271 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:21.824883    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:22.822386 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:22.822352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:22.822567 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:22.822390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:22.822567 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:22.822477    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:22.822685 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:22.822568    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:23.834522 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:23.834487    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:23.834984 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:23.834607    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:24.821886 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:24.821844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:24.822053 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:24.821911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:24.822053 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:24.822026    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:24.822192 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:24.822165    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:25.822222 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:25.821957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:25.822629 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:25.822343    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:26.822153 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:26.822119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:26.822153 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:26.822148    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:26.822634 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:26.822272    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:26.822634 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:26.822378    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:27.387125 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:27.387087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:27.387318 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:27.387185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:27.387318 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.387253    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:27.387414 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.387326    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret podName:cb9b5ee3-6870-45f9-9998-33e9ce83e284 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:43.387308927 +0000 UTC m=+34.150840025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret") pod "global-pull-secret-syncer-cghb6" (UID: "cb9b5ee3-6870-45f9-9998-33e9ce83e284") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:27.387414 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.387334    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:27.387414 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.387352    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:27.387414 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.387365    2576 projected.go:196] Error preparing data for projected volume kube-api-access-wmn75 for pod openshift-network-diagnostics/network-check-target-vvzjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:27.387613 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.387420    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75 podName:21a6a7c5-fd48-494d-8a96-8e52cdd9abcd nodeName:}" failed. No retries permitted until 2026-07-02 21:31:43.387404375 +0000 UTC m=+34.150935490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmn75" (UniqueName: "kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75") pod "network-check-target-vvzjb" (UID: "21a6a7c5-fd48-494d-8a96-8e52cdd9abcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:27.488169 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:27.488093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:27.488367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.488224    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:27.488367 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.488308    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:31:43.488290202 +0000 UTC m=+34.251821315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:27.821875 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:27.821800    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:27.822016 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:27.821924    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:28.821970 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:28.821935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:28.822444 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:28.821935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:28.822444 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:28.822049    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:28.822444 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:28.822101    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:29.822889 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:29.822854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:29.823328 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:29.822959    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:30.821953 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:30.821919    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:30.822121 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:30.821919    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:30.822121 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:30.822039    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:30.822198 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:30.822132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:31.822712 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.822502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:31.823473 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:31.822808    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:31.896964 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.896938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" event={"ID":"0caf382ca9eb296da259b7ea66c7880a","Type":"ContainerStarted","Data":"116059a7e2380a0b41ba5aef2e67f5a9c4ae163efd0515355a7fd234964b7b30"}
Jul 02 21:31:31.898336 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.898312    2576 generic.go:356] "Generic (PLEG): container finished" podID="1375989dc36f18a986154f7263a01ba9" containerID="989a52ac343dc2beae9c3ca58530bfb28c0d9e55f525edfa9ca9fb99ae036e45" exitCode=0
Jul 02 21:31:31.898431 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.898388    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"1375989dc36f18a986154f7263a01ba9","Type":"ContainerDied","Data":"989a52ac343dc2beae9c3ca58530bfb28c0d9e55f525edfa9ca9fb99ae036e45"}
Jul 02 21:31:31.899764 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.899744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5zr5v" event={"ID":"2c8e3666-51cb-4bf8-a213-70955f980526","Type":"ContainerStarted","Data":"5cfca8759d5db94d29e1600ca3e534fd9de1134578e2355df81b5ef5507779df"}
Jul 02 21:31:31.901255 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.901232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5" event={"ID":"bd8a614c-3357-407d-9e96-3d4c62ac3652","Type":"ContainerStarted","Data":"676255c1df1642da2ada94d15f2b896ddaad8abb912be97b9254ade846b60944"}
Jul 02 21:31:31.902553 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.902531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdjtc" event={"ID":"7d91e315-8f33-467a-ae0e-7dafc94c0c1b","Type":"ContainerStarted","Data":"a7d7f34b32408d23b01a048985547d7aec8c68e30d6098da999c0fef34a243d6"}
Jul 02 21:31:31.903785 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.903764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cgdzp" event={"ID":"3069c2f7-c164-4f24-bed1-d0a10fa4ca3b","Type":"ContainerStarted","Data":"ed57bdbc5b18be341e710202407098faef4cf1ec3644914c7eec917e75f0737c"}
Jul 02 21:31:31.904990 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.904972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lbfjz" event={"ID":"4bffaf14-d6f2-422c-8fab-b77bdea1460f","Type":"ContainerStarted","Data":"47049aaa331ce80ae80757ed2b768dff0b987289ec24b89e6f74cab2cd99151c"}
Jul 02 21:31:31.906282 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.906263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m9hbb" event={"ID":"8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2","Type":"ContainerStarted","Data":"7bf5339e421ea26879853a55a437619e2ca27c63a177e496b10eea0a4c33b8f6"}
Jul 02 21:31:31.910566 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.910537    2576 generic.go:356] "Generic (PLEG): container finished" podID="21be25c2-8baf-4144-9569-3bff04f3b515" containerID="296d723be8fcef375d95c43dfad13f4c2e9b787b92b56b5e7985d2f53debbd27" exitCode=0
Jul 02 21:31:31.910662 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.910621    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerDied","Data":"296d723be8fcef375d95c43dfad13f4c2e9b787b92b56b5e7985d2f53debbd27"}
Jul 02 21:31:31.912896 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.912872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"1cc03560395e15a0d3933415cb26bedf1478c8548f0553061d790ce11bf04684"}
Jul 02 21:31:31.912983 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.912932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"b128d320fd5000c5174166a93828cee1846f8fbc4538bd941f9ad6d9d6aefd87"}
Jul 02 21:31:31.912983 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.912963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"663cac7adc07c75b3259237a58956d3e8e5941a20d50c375b936388c52807d9e"}
Jul 02 21:31:31.954466 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.954283    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cgdzp" podStartSLOduration=2.7647671110000003 podStartE2EDuration="21.954262493s" totalImagesPullingTime="19.189495382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:31.931299043 +0000 UTC m=+22.694830166" watchObservedRunningTime="2026-07-02 21:31:31.954262493 +0000 UTC m=+22.717793616"
Jul 02 21:31:31.968218 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:31.968158    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lbfjz" podStartSLOduration=2.7992323900000002 podStartE2EDuration="21.96814245s" totalImagesPullingTime="19.16891006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:31.968024021 +0000 UTC m=+22.731555142" watchObservedRunningTime="2026-07-02 21:31:31.96814245 +0000 UTC m=+22.731673618"
Jul 02 21:31:32.004604 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.004564    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vdjtc" podStartSLOduration=2.822463629 podStartE2EDuration="22.004548793s" totalImagesPullingTime="19.182085164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:31.987383479 +0000 UTC m=+22.750914611" watchObservedRunningTime="2026-07-02 21:31:32.004548793 +0000 UTC m=+22.768079912"
Jul 02 21:31:32.004805 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.004785    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5zr5v" podStartSLOduration=2.888773659 podStartE2EDuration="22.004780445s" totalImagesPullingTime="19.116006786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:32.004342774 +0000 UTC m=+22.767873894" watchObservedRunningTime="2026-07-02 21:31:32.004780445 +0000 UTC m=+22.768311565"
Jul 02 21:31:32.020681 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.020635    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" podStartSLOduration=21.020616824 podStartE2EDuration="21.020616824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:32.019916947 +0000 UTC m=+22.783448067" watchObservedRunningTime="2026-07-02 21:31:32.020616824 +0000 UTC m=+22.784147947"
Jul 02 21:31:32.807938 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.807911    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 21:31:32.821700 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.821679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:32.821821 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.821688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:32.821821 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:32.821778    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:32.821941 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:32.821923    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:32.917536 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.917496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"1375989dc36f18a986154f7263a01ba9","Type":"ContainerStarted","Data":"e521c3b80770d757715373606e9db55bcd75f0a9798c24a8b71bb543114b781b"}
Jul 02 21:31:32.919601 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.919570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5" event={"ID":"bd8a614c-3357-407d-9e96-3d4c62ac3652","Type":"ContainerStarted","Data":"6477075299d1f5ef2697bf36daf5df35a6069d2de3f7a38e68d8bfe44775109c"}
Jul 02 21:31:32.921264 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.921237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v2k7m" event={"ID":"e18bdcde-c266-45b9-982b-138d88cb71dc","Type":"ContainerStarted","Data":"4fc5066f412c7fd811cc6768c0f168cf102590398b3d688ef79155a24ed01c0c"}
Jul 02 21:31:32.924586 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.924554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"2a3f52ce77417a00df3b0f8a05fd00b86d19d7d1521dea34af9be96baf03fe58"}
Jul 02 21:31:32.924709 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.924635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"1af7235d8f63c22442acc11c52318bccc15ab3a227859a9476ffa45e685f9bb2"}
Jul 02 21:31:32.924709 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.924668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"110e235db08d5273fec2bfadd8bbe978352df1e6e287a8a37e19999585a56b5d"}
Jul 02 21:31:32.933754 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.933674    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m9hbb" podStartSLOduration=3.719024136 podStartE2EDuration="22.933663091s" totalImagesPullingTime="19.214638955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:32.035278731 +0000 UTC m=+22.798809850" watchObservedRunningTime="2026-07-02 21:31:32.933663091 +0000 UTC m=+23.697194211"
Jul 02 21:31:32.934130 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:32.934100    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" podStartSLOduration=21.934093138 podStartE2EDuration="21.934093138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:32.933530614 +0000 UTC m=+23.697061745" watchObservedRunningTime="2026-07-02 21:31:32.934093138 +0000 UTC m=+23.697624258"
Jul 02 21:31:33.727426 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:33.727297    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T21:31:32.807931392Z","UUID":"d4b7a2f2-2425-4322-a948-b0bfff05bbc8","Handler":null,"Name":"","Endpoint":""}
Jul 02 21:31:33.729072 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:33.729044    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 21:31:33.729237 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:33.729091    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 21:31:33.822066 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:33.822025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:33.822304 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:33.822174    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:34.261816 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:34.261778    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:34.262865 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:34.262843    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:34.280602 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:34.279055    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v2k7m" podStartSLOduration=5.126716592 podStartE2EDuration="24.2790333s" totalImagesPullingTime="19.152316708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:32.949020677 +0000 UTC m=+23.712551798" watchObservedRunningTime="2026-07-02 21:31:34.2790333 +0000 UTC m=+25.042564421"
Jul 02 21:31:34.821892 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:34.821817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:34.822056 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:34.821944    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:34.822056 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:34.821996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:34.822167 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:34.822094    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:34.932362 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:34.932323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"6de17589e7a448b819ce6bab7918a359b1fb4f3a661bb432ccf2fe7dc7d532fd"}
Jul 02 21:31:34.934587 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:34.934554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5" event={"ID":"bd8a614c-3357-407d-9e96-3d4c62ac3652","Type":"ContainerStarted","Data":"9d75d738a9b47053c69ceda55c8ab9827be2335cde535d84bb8e34c5ce750b05"}
Jul 02 21:31:35.821676 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:35.821644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:35.822156 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:35.821765    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:36.822429 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.822028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:36.822429 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.822057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:36.823183 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:36.822452    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:36.823183 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:36.822559    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:36.940195 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.940166    2576 generic.go:356] "Generic (PLEG): container finished" podID="21be25c2-8baf-4144-9569-3bff04f3b515" containerID="63a478b5f66e703ad7a9015a148990d719126edd6649a2834a6bc628dfe3f7d5" exitCode=0
Jul 02 21:31:36.940360 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.940242    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerDied","Data":"63a478b5f66e703ad7a9015a148990d719126edd6649a2834a6bc628dfe3f7d5"}
Jul 02 21:31:36.944027 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.944001    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" event={"ID":"c87a09d1-22d3-495a-93d6-fbf38c83626f","Type":"ContainerStarted","Data":"e3ae75ddc5a96a009e287c75cc66af60ba54a4020c31451b407642e99081de1e"}
Jul 02 21:31:36.944332 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.944308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:36.944417 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.944381    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:36.959661 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.959633    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:36.962405 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.962356    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wmk5" podStartSLOduration=5.041096821 podStartE2EDuration="26.962342744s" totalImagesPullingTime="21.921245923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:34.952502858 +0000 UTC m=+25.716033979" watchObservedRunningTime="2026-07-02 21:31:36.962342744 +0000 UTC m=+27.725873861"
Jul 02 21:31:36.986947 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:36.986903    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj" podStartSLOduration=7.578105693 podStartE2EDuration="26.986888807s" totalImagesPullingTime="19.408783114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:36.985635154 +0000 UTC m=+27.749166274" watchObservedRunningTime="2026-07-02 21:31:36.986888807 +0000 UTC m=+27.750419926"
Jul 02 21:31:37.821941 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:37.821913    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:37.822109 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:37.822038    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:37.950086 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:37.950048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerStarted","Data":"bbce12d0e3c5f2109ecf0224c6d047cd7dcf3e47b93d82b01261ed2deb3886aa"}
Jul 02 21:31:37.950927 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:37.950491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:37.968314 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:37.968286    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:31:38.822556 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.822387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:38.822721 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.822389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:38.822721 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:38.822628    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:38.822721 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:38.822703    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:38.933088 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.933057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvzjb"]
Jul 02 21:31:38.935702 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.935677    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5brlj"]
Jul 02 21:31:38.936008 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.935824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:38.936008 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:38.935948    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:38.950639 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.950610    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cghb6"]
Jul 02 21:31:38.954073 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.954050    2576 generic.go:356] "Generic (PLEG): container finished" podID="21be25c2-8baf-4144-9569-3bff04f3b515" containerID="bbce12d0e3c5f2109ecf0224c6d047cd7dcf3e47b93d82b01261ed2deb3886aa" exitCode=0
Jul 02 21:31:38.954190 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.954098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerDied","Data":"bbce12d0e3c5f2109ecf0224c6d047cd7dcf3e47b93d82b01261ed2deb3886aa"}
Jul 02 21:31:38.954564 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.954543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:38.954681 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:38.954659    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:38.954756 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:38.954710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:38.954863 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:38.954822    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:39.959270 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:39.959231    2576 generic.go:356] "Generic (PLEG): container finished" podID="21be25c2-8baf-4144-9569-3bff04f3b515" containerID="2dd9ce145b0d12694d33b56ffd4ae02042260468e1a73f6dd23ed1773d62ff24" exitCode=0
Jul 02 21:31:39.959716 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:39.959317    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerDied","Data":"2dd9ce145b0d12694d33b56ffd4ae02042260468e1a73f6dd23ed1773d62ff24"}
Jul 02 21:31:40.228321 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:40.228282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:40.228610 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:40.228431    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 21:31:40.228879 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:40.228861    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5zr5v"
Jul 02 21:31:40.822501 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:40.822465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:40.822662 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:40.822468    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:40.822662 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:40.822621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:40.822662 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:40.822622    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:40.822786 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:40.822735    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:40.822839 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:40.822819    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:42.821756 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:42.821706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:42.821756 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:42.821745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:42.822267 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:42.821822    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:42.822267 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:42.821842    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cghb6" podUID="cb9b5ee3-6870-45f9-9998-33e9ce83e284"
Jul 02 21:31:42.822267 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:42.821932    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:31:42.822267 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:42.821991    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvzjb" podUID="21a6a7c5-fd48-494d-8a96-8e52cdd9abcd"
Jul 02 21:31:43.409779 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:43.409735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:43.409967 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:43.409804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:43.409967 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.409934    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:43.409967 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.409961    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:43.410132 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.409980    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:43.410132 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.409990    2576 projected.go:196] Error preparing data for projected volume kube-api-access-wmn75 for pod openshift-network-diagnostics/network-check-target-vvzjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:43.410132 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.410011    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret podName:cb9b5ee3-6870-45f9-9998-33e9ce83e284 nodeName:}" failed. No retries permitted until 2026-07-02 21:32:15.409991295 +0000 UTC m=+66.173522393 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret") pod "global-pull-secret-syncer-cghb6" (UID: "cb9b5ee3-6870-45f9-9998-33e9ce83e284") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:43.410132 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.410034    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75 podName:21a6a7c5-fd48-494d-8a96-8e52cdd9abcd nodeName:}" failed. No retries permitted until 2026-07-02 21:32:15.41002419 +0000 UTC m=+66.173555294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmn75" (UniqueName: "kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75") pod "network-check-target-vvzjb" (UID: "21a6a7c5-fd48-494d-8a96-8e52cdd9abcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:43.510985 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:43.510953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:43.511147 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.511121    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:43.511240 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:43.511178    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:32:15.51116461 +0000 UTC m=+66.274695713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:44.061162 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.060926    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeReady"
Jul 02 21:31:44.061598 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.061258    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 21:31:44.106117 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.106068    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tmr6x"]
Jul 02 21:31:44.130750 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.130715    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hqk98"]
Jul 02 21:31:44.130897 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.130840    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.133244 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.133198    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 21:31:44.133244 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.133223    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 21:31:44.133423 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.133266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-knz6t\""
Jul 02 21:31:44.161855 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.161829    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tmr6x"]
Jul 02 21:31:44.161969 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.161865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hqk98"]
Jul 02 21:31:44.161969 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.161927    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.164316 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.164296    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 21:31:44.164316 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.164296    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gnsm2\""
Jul 02 21:31:44.164548 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.164451    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 21:31:44.164781 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.164766    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 21:31:44.316137 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.316061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.316137 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.316115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb304ebd-fcbe-43b8-a6c9-a758e42b0017-cert\") pod \"ingress-canary-hqk98\" (UID: \"fb304ebd-fcbe-43b8-a6c9-a758e42b0017\") " pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.316332 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.316147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnkf\" (UniqueName: \"kubernetes.io/projected/fb304ebd-fcbe-43b8-a6c9-a758e42b0017-kube-api-access-4rnkf\") pod \"ingress-canary-hqk98\" (UID: \"fb304ebd-fcbe-43b8-a6c9-a758e42b0017\") " pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.316332 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.316236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-config-volume\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.316332 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.316262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-tmp-dir\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.316332 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.316280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5jnj\" (UniqueName: \"kubernetes.io/projected/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-kube-api-access-s5jnj\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.417447 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.417415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb304ebd-fcbe-43b8-a6c9-a758e42b0017-cert\") pod \"ingress-canary-hqk98\" (UID: \"fb304ebd-fcbe-43b8-a6c9-a758e42b0017\") " pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.417565 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.417455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnkf\" (UniqueName: \"kubernetes.io/projected/fb304ebd-fcbe-43b8-a6c9-a758e42b0017-kube-api-access-4rnkf\") pod \"ingress-canary-hqk98\" (UID: \"fb304ebd-fcbe-43b8-a6c9-a758e42b0017\") " pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.417565 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.417481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-config-volume\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.417565 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.417502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-tmp-dir\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.417565 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.417527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5jnj\" (UniqueName: \"kubernetes.io/projected/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-kube-api-access-s5jnj\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.417743 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.417582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.417743 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:44.417678    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:44.417833 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:44.417748    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:31:44.91773083 +0000 UTC m=+35.681261927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:44.417928 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.417904    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-tmp-dir\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.418023 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.418005    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-config-volume\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.421668 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.421649    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb304ebd-fcbe-43b8-a6c9-a758e42b0017-cert\") pod \"ingress-canary-hqk98\" (UID: \"fb304ebd-fcbe-43b8-a6c9-a758e42b0017\") " pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.428139 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.428115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5jnj\" (UniqueName: \"kubernetes.io/projected/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-kube-api-access-s5jnj\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.428139 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.428126    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnkf\" (UniqueName: \"kubernetes.io/projected/fb304ebd-fcbe-43b8-a6c9-a758e42b0017-kube-api-access-4rnkf\") pod \"ingress-canary-hqk98\" (UID: \"fb304ebd-fcbe-43b8-a6c9-a758e42b0017\") " pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.470091 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.470058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hqk98"
Jul 02 21:31:44.674602 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.674381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hqk98"]
Jul 02 21:31:44.677721 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:31:44.677696    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb304ebd_fcbe_43b8_a6c9_a758e42b0017.slice/crio-3b21e432cea0d0269be7293ed89e6ca5db65e6e3dd387985af635148b515729d WatchSource:0}: Error finding container 3b21e432cea0d0269be7293ed89e6ca5db65e6e3dd387985af635148b515729d: Status 404 returned error can't find the container with id 3b21e432cea0d0269be7293ed89e6ca5db65e6e3dd387985af635148b515729d
Jul 02 21:31:44.822165 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.822093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:31:44.822321 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.822093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:31:44.822321 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.822096    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:31:44.825111 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.825091    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 21:31:44.825248 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.825150    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 21:31:44.825362 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.825344    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 21:31:44.826220 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.826191    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7x7kj\""
Jul 02 21:31:44.826320 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.826262    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sm2np\""
Jul 02 21:31:44.826320 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.826273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 21:31:44.921988 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.921953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:44.922155 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:44.922136    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:44.922252 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:44.922238    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:31:45.922192985 +0000 UTC m=+36.685724098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:44.976069 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.976040    2576 generic.go:356] "Generic (PLEG): container finished" podID="21be25c2-8baf-4144-9569-3bff04f3b515" containerID="ee14dc8cd3b1cd2867c4e390d48bd12a8c57c906eb65f7092713285fc215e01e" exitCode=0
Jul 02 21:31:44.976266 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.976070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerDied","Data":"ee14dc8cd3b1cd2867c4e390d48bd12a8c57c906eb65f7092713285fc215e01e"}
Jul 02 21:31:44.977353 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:44.977329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hqk98" event={"ID":"fb304ebd-fcbe-43b8-a6c9-a758e42b0017","Type":"ContainerStarted","Data":"3b21e432cea0d0269be7293ed89e6ca5db65e6e3dd387985af635148b515729d"}
Jul 02 21:31:45.930888 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:45.930856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:45.931827 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:45.931033    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:45.931827 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:45.931116    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:31:47.931092372 +0000 UTC m=+38.694623472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:45.981959 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:45.981927    2576 generic.go:356] "Generic (PLEG): container finished" podID="21be25c2-8baf-4144-9569-3bff04f3b515" containerID="ac7964fceaceaea036c0489b4df3b8ba81c8729c92dbfd8e6bd8f70878cd305d" exitCode=0
Jul 02 21:31:45.982112 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:45.981974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerDied","Data":"ac7964fceaceaea036c0489b4df3b8ba81c8729c92dbfd8e6bd8f70878cd305d"}
Jul 02 21:31:46.988441 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:46.988406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" event={"ID":"21be25c2-8baf-4144-9569-3bff04f3b515","Type":"ContainerStarted","Data":"60ef63df5c324bdd50430a06701d7d41f71d614664ed52ed29aa4a0518336f95"}
Jul 02 21:31:47.019664 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:47.019607    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7b9m9" podStartSLOduration=6.949923506 podStartE2EDuration="37.019588242s" totalImagesPullingTime="30.069664736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:47.019553874 +0000 UTC m=+37.783084994" watchObservedRunningTime="2026-07-02 21:31:47.019588242 +0000 UTC m=+37.783119359"
Jul 02 21:31:47.946693 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:47.946651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:47.946869 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:47.946763    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:47.946869 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:47.946826    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:31:51.946811028 +0000 UTC m=+42.710342127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:47.992532 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:47.992494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hqk98" event={"ID":"fb304ebd-fcbe-43b8-a6c9-a758e42b0017","Type":"ContainerStarted","Data":"a6de7aeae92d9219cd241705606d52c335c6c60eef075241a878fa61eb1dadef"}
Jul 02 21:31:48.010338 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:48.010292    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hqk98" podStartSLOduration=1.39361653 podStartE2EDuration="4.010277388s" totalImagesPullingTime="2.616660858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:48.009664729 +0000 UTC m=+38.773195862" watchObservedRunningTime="2026-07-02 21:31:48.010277388 +0000 UTC m=+38.773808507"
Jul 02 21:31:51.971759 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:31:51.971717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:31:51.972131 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:51.971865    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:51.972131 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:31:51.971928    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:31:59.971913566 +0000 UTC m=+50.735444665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:32:00.021264 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:00.021229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:32:00.021709 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:00.021367    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:32:00.021709 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:00.021428    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:32:16.021409777 +0000 UTC m=+66.784940876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:32:09.969531 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:09.969500    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqqj"
Jul 02 21:32:15.426999 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.426956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:32:15.427467 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.427023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:32:15.429683 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.429664    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 21:32:15.429759 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.429728    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 21:32:15.440366 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.440344    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 21:32:15.441345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.441318    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb9b5ee3-6870-45f9-9998-33e9ce83e284-original-pull-secret\") pod \"global-pull-secret-syncer-cghb6\" (UID: \"cb9b5ee3-6870-45f9-9998-33e9ce83e284\") " pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:32:15.450630 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.450608    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmn75\" (UniqueName: \"kubernetes.io/projected/21a6a7c5-fd48-494d-8a96-8e52cdd9abcd-kube-api-access-wmn75\") pod \"network-check-target-vvzjb\" (UID: \"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd\") " pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:32:15.528144 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.528108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:32:15.530597 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.530578    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 21:32:15.538659 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:15.538642    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 21:32:15.538761 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:15.538709    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:33:19.538693499 +0000 UTC m=+130.302224597 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : secret "metrics-daemon-secret" not found
Jul 02 21:32:15.731859 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.731781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cghb6"
Jul 02 21:32:15.740293 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.740271    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sm2np\""
Jul 02 21:32:15.748454 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.748436    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:32:15.893863 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.893809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cghb6"]
Jul 02 21:32:15.896722 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:32:15.896695    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9b5ee3_6870_45f9_9998_33e9ce83e284.slice/crio-2a421b73e0062b8c897c34f33b2d90dd91fe8fc64f0da0d3948ba44a40f80d5c WatchSource:0}: Error finding container 2a421b73e0062b8c897c34f33b2d90dd91fe8fc64f0da0d3948ba44a40f80d5c: Status 404 returned error can't find the container with id 2a421b73e0062b8c897c34f33b2d90dd91fe8fc64f0da0d3948ba44a40f80d5c
Jul 02 21:32:15.908068 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:15.908042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvzjb"]
Jul 02 21:32:15.910846 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:32:15.910818    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a6a7c5_fd48_494d_8a96_8e52cdd9abcd.slice/crio-ab5ca093df313f91af6efc4cd73dbba1ff3f0e525e0154983f3fef4f99260b95 WatchSource:0}: Error finding container ab5ca093df313f91af6efc4cd73dbba1ff3f0e525e0154983f3fef4f99260b95: Status 404 returned error can't find the container with id ab5ca093df313f91af6efc4cd73dbba1ff3f0e525e0154983f3fef4f99260b95
Jul 02 21:32:16.032789 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:16.032691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:32:16.032918 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:16.032821    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:32:16.032918 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:16.032878    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:32:48.032862226 +0000 UTC m=+98.796393325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:32:16.058962 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:16.058914    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvzjb" event={"ID":"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd","Type":"ContainerStarted","Data":"ab5ca093df313f91af6efc4cd73dbba1ff3f0e525e0154983f3fef4f99260b95"}
Jul 02 21:32:16.060133 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:16.060107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cghb6" event={"ID":"cb9b5ee3-6870-45f9-9998-33e9ce83e284","Type":"ContainerStarted","Data":"2a421b73e0062b8c897c34f33b2d90dd91fe8fc64f0da0d3948ba44a40f80d5c"}
Jul 02 21:32:21.076372 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:21.076338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvzjb" event={"ID":"21a6a7c5-fd48-494d-8a96-8e52cdd9abcd","Type":"ContainerStarted","Data":"a16b60b67648c40b7be8ca1a224b2f5faf6d326cd9f4e972794a820915d7c09c"}
Jul 02 21:32:21.076920 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:21.076422    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:32:21.077733 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:21.077692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cghb6" event={"ID":"cb9b5ee3-6870-45f9-9998-33e9ce83e284","Type":"ContainerStarted","Data":"efa00e4b43730e0d4fb48edb4e8bca894db97467893b5a3363f42d541169b59e"}
Jul 02 21:32:21.091934 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:21.091885    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vvzjb" podStartSLOduration=66.818753075 podStartE2EDuration="1m11.091870976s" totalImagesPullingTime="4.273117901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:21.091736392 +0000 UTC m=+71.855267513" watchObservedRunningTime="2026-07-02 21:32:21.091870976 +0000 UTC m=+71.855402094"
Jul 02 21:32:21.110569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:21.110502    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cghb6" podStartSLOduration=66.820645554 podStartE2EDuration="1m11.110486513s" totalImagesPullingTime="4.289840959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:21.110100765 +0000 UTC m=+71.873631885" watchObservedRunningTime="2026-07-02 21:32:21.110486513 +0000 UTC m=+71.874017636"
Jul 02 21:32:31.294714 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.294593    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"]
Jul 02 21:32:31.296806 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.296457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.300417 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.300393    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 21:32:31.300569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.300392    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 21:32:31.300569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.300395    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 21:32:31.300569 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.300442    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 21:32:31.309721 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.309680    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"]
Jul 02 21:32:31.310460 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.310442    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"]
Jul 02 21:32:31.312268 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.312251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.315011 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.314974    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 21:32:31.315113 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.315040    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 21:32:31.315159 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.315142    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 21:32:31.315495 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.315480    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 21:32:31.326382 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.326363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"]
Jul 02 21:32:31.340100 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.340079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-tmp\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.340234 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.340122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.340234 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.340151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxhth\" (UniqueName: \"kubernetes.io/projected/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-kube-api-access-sxhth\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.440772 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-hub\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.440772 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.440966 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd2f31a-1f61-477a-b143-0573663b3652-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.440966 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.440966 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnd2d\" (UniqueName: \"kubernetes.io/projected/ddd2f31a-1f61-477a-b143-0573663b3652-kube-api-access-qnd2d\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.440966 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-tmp\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.440966 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-ca\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.440966 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.441142 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.440991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxhth\" (UniqueName: \"kubernetes.io/projected/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-kube-api-access-sxhth\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.441377 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.441358    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-tmp\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.443487 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.443467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.449129 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.449106    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxhth\" (UniqueName: \"kubernetes.io/projected/3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05-kube-api-access-sxhth\") pod \"klusterlet-addon-workmgr-6d745f5d5c-g7kjs\" (UID: \"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.541953 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.541921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-hub\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.541953 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.541956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.542229 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.541976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd2f31a-1f61-477a-b143-0573663b3652-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.542229 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.542001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.542229 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.542025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnd2d\" (UniqueName: \"kubernetes.io/projected/ddd2f31a-1f61-477a-b143-0573663b3652-kube-api-access-qnd2d\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.542229 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.542145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-ca\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.542771 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.542747    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd2f31a-1f61-477a-b143-0573663b3652-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.544415 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.544385    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-ca\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.544645 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.544621    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-hub\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.544859 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.544823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.544859 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.544845    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddd2f31a-1f61-477a-b143-0573663b3652-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.550252 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.550228    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnd2d\" (UniqueName: \"kubernetes.io/projected/ddd2f31a-1f61-477a-b143-0573663b3652-kube-api-access-qnd2d\") pod \"cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx\" (UID: \"ddd2f31a-1f61-477a-b143-0573663b3652\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.605333 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.605297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:31.636126 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.636088    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:32:31.734041 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.733967    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"]
Jul 02 21:32:31.738737 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:32:31.738707    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0ac0b0_feb9_469e_b35e_b04e2bc7bb05.slice/crio-1ee110f3bc037c377d3b24182ed869aecde69fe78c3694bab96a52ff151b76a3 WatchSource:0}: Error finding container 1ee110f3bc037c377d3b24182ed869aecde69fe78c3694bab96a52ff151b76a3: Status 404 returned error can't find the container with id 1ee110f3bc037c377d3b24182ed869aecde69fe78c3694bab96a52ff151b76a3
Jul 02 21:32:31.765524 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:31.765492    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"]
Jul 02 21:32:31.768299 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:32:31.768276    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddd2f31a_1f61_477a_b143_0573663b3652.slice/crio-1b26b2351f0ab7bc71c518e4fa0f4268733a00b411103e36e013e5e77cff34c2 WatchSource:0}: Error finding container 1b26b2351f0ab7bc71c518e4fa0f4268733a00b411103e36e013e5e77cff34c2: Status 404 returned error can't find the container with id 1b26b2351f0ab7bc71c518e4fa0f4268733a00b411103e36e013e5e77cff34c2
Jul 02 21:32:32.103843 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:32.103805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" event={"ID":"ddd2f31a-1f61-477a-b143-0573663b3652","Type":"ContainerStarted","Data":"1b26b2351f0ab7bc71c518e4fa0f4268733a00b411103e36e013e5e77cff34c2"}
Jul 02 21:32:32.104910 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:32.104889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs" event={"ID":"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05","Type":"ContainerStarted","Data":"1ee110f3bc037c377d3b24182ed869aecde69fe78c3694bab96a52ff151b76a3"}
Jul 02 21:32:36.118186 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:36.118093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs" event={"ID":"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05","Type":"ContainerStarted","Data":"08fd2c4191937eb3f5f51621314a1eb9310fd69abb5876daecbd674ed8d9446b"}
Jul 02 21:32:36.118571 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:36.118319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:36.119950 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:36.119931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:32:36.135911 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:36.135864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs" podStartSLOduration=1.069034102 podStartE2EDuration="5.13584882s" totalImagesPullingTime="4.066814718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:36.135028773 +0000 UTC m=+86.898559903" watchObservedRunningTime="2026-07-02 21:32:36.13584882 +0000 UTC m=+86.899379940"
Jul 02 21:32:47.150371 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:47.150334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" event={"ID":"ddd2f31a-1f61-477a-b143-0573663b3652","Type":"ContainerStarted","Data":"e65957b5f856cefeccd7661dd34b9475dc2096a76ccbb59548d7580754fb7a9e"}
Jul 02 21:32:47.150731 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:47.150382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" event={"ID":"ddd2f31a-1f61-477a-b143-0573663b3652","Type":"ContainerStarted","Data":"f7253d999a832a0999ea5f279062b029e850a4bd757677235607f0549349eb5a"}
Jul 02 21:32:47.150731 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:47.150396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" event={"ID":"ddd2f31a-1f61-477a-b143-0573663b3652","Type":"ContainerStarted","Data":"bd8f33aeba833e2117754cc56b40673a2e8e8324d7bcb9a239a6f8483a8104f5"}
Jul 02 21:32:47.173524 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:47.173344    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" podStartSLOduration=1.036548084 podStartE2EDuration="16.17332936s" totalImagesPullingTime="15.136781276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:47.172690929 +0000 UTC m=+97.936222063" watchObservedRunningTime="2026-07-02 21:32:47.17332936 +0000 UTC m=+97.936860480"
Jul 02 21:32:48.066321 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:48.066281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:32:48.066483 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:48.066443    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:32:48.066523 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:32:48.066517    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:33:52.066500835 +0000 UTC m=+162.830031933 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:32:52.082258 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:32:52.082198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vvzjb"
Jul 02 21:33:19.585788 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:33:19.585745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:33:19.586319 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:33:19.585883    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 21:33:19.586319 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:33:19.585949    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:35:21.585931982 +0000 UTC m=+252.349463080 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : secret "metrics-daemon-secret" not found
Jul 02 21:33:47.140365 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:33:47.140312    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tmr6x" podUID="d86fe2fe-825f-47f2-b0e5-5dbee05aa11a"
Jul 02 21:33:47.319686 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:33:47.319656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:33:47.842817 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:33:47.842780    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:33:52.099917 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:33:52.099881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:33:52.100332 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:33:52.100037    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:33:52.100332 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:33:52.100120    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls podName:d86fe2fe-825f-47f2-b0e5-5dbee05aa11a nodeName:}" failed. No retries permitted until 2026-07-02 21:35:54.100103015 +0000 UTC m=+284.863634118 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls") pod "dns-default-tmr6x" (UID: "d86fe2fe-825f-47f2-b0e5-5dbee05aa11a") : secret "dns-default-metrics-tls" not found
Jul 02 21:33:59.822923 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:33:59.822890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:34:36.119469 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:34:36.119420    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs" podUID="3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 02 21:34:36.453000 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:34:36.452966    2576 generic.go:356] "Generic (PLEG): container finished" podID="3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05" containerID="08fd2c4191937eb3f5f51621314a1eb9310fd69abb5876daecbd674ed8d9446b" exitCode=1
Jul 02 21:34:36.453152 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:34:36.453036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs" event={"ID":"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05","Type":"ContainerDied","Data":"08fd2c4191937eb3f5f51621314a1eb9310fd69abb5876daecbd674ed8d9446b"}
Jul 02 21:34:36.453379 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:34:36.453366    2576 scope.go:117] "RemoveContainer" containerID="08fd2c4191937eb3f5f51621314a1eb9310fd69abb5876daecbd674ed8d9446b"
Jul 02 21:34:37.457625 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:34:37.457591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs" event={"ID":"3c0ac0b0-feb9-469e-b35e-b04e2bc7bb05","Type":"ContainerStarted","Data":"536e56a4c709fe0f5cd290430eaf141880336e21dbfe3a55833c7c57f8476da3"}
Jul 02 21:34:37.458020 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:34:37.457864    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:34:37.458465 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:34:37.458446    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d745f5d5c-g7kjs"
Jul 02 21:35:21.613003 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:21.612968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:35:21.613456 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:21.613114    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 21:35:21.613456 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:21.613186    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs podName:2c71f14d-4178-48a4-a229-16e98c2fe8ba nodeName:}" failed. No retries permitted until 2026-07-02 21:37:23.613169038 +0000 UTC m=+374.376700135 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs") pod "network-metrics-daemon-5brlj" (UID: "2c71f14d-4178-48a4-a229-16e98c2fe8ba") : secret "metrics-daemon-secret" not found
Jul 02 21:35:24.416590 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.416559    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8w44t"]
Jul 02 21:35:24.418704 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.418682    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.420846 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.420821    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 21:35:24.421001 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.420985    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 21:35:24.421073 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.421049    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 21:35:24.421867 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.421851    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 21:35:24.421948 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.421871    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-97hq6\""
Jul 02 21:35:24.429144 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.429117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8w44t"]
Jul 02 21:35:24.533345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.533310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00421924-e802-4ebc-b9fe-8caa1900be66-data-volume\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.533345 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.533352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.533572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.533436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9lw8\" (UniqueName: \"kubernetes.io/projected/00421924-e802-4ebc-b9fe-8caa1900be66-kube-api-access-t9lw8\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.533572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.533524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00421924-e802-4ebc-b9fe-8caa1900be66-crio-socket\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.533572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.533553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634315 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.634270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00421924-e802-4ebc-b9fe-8caa1900be66-data-volume\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634510 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.634352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634510 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.634391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9lw8\" (UniqueName: \"kubernetes.io/projected/00421924-e802-4ebc-b9fe-8caa1900be66-kube-api-access-t9lw8\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634510 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.634456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00421924-e802-4ebc-b9fe-8caa1900be66-crio-socket\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634510 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.634487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634713 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:24.634503    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:24.634713 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.634577    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00421924-e802-4ebc-b9fe-8caa1900be66-crio-socket\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634713 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:24.634612    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:25.134595997 +0000 UTC m=+255.898127100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:24.634713 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:24.634623    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:24.634713 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.634639    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00421924-e802-4ebc-b9fe-8caa1900be66-data-volume\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:24.634713 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:24.634683    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:25.13466584 +0000 UTC m=+255.898196957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:24.642572 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:24.642539    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9lw8\" (UniqueName: \"kubernetes.io/projected/00421924-e802-4ebc-b9fe-8caa1900be66-kube-api-access-t9lw8\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:25.138326 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:25.138279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:25.138568 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:25.138362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:25.138568 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:25.138431    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:25.138568 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:25.138438    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:25.138568 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:25.138483    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:26.138468824 +0000 UTC m=+256.901999921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:25.138568 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:25.138502    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:26.138488494 +0000 UTC m=+256.902019593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:26.145226 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:26.145171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:26.145630 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:26.145241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:26.145630 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:26.145316    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:26.145630 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:26.145361    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:26.145630 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:26.145397    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:28.145379615 +0000 UTC m=+258.908910713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:26.145630 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:26.145423    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:28.14540923 +0000 UTC m=+258.908940331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:26.394520 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:26.394490    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m9hbb_8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2/dns-node-resolver/0.log"
Jul 02 21:35:27.594728 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:27.594698    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lbfjz_4bffaf14-d6f2-422c-8fab-b77bdea1460f/node-ca/0.log"
Jul 02 21:35:28.158858 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:28.158807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:28.159043 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:28.158890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:28.159043 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:28.158955    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:28.159043 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:28.158963    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:28.159043 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:28.159018    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:32.15900163 +0000 UTC m=+262.922532727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:28.159043 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:28.159031    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:32.159024627 +0000 UTC m=+262.922555725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:28.396228 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:28.396158    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hqk98_fb304ebd-fcbe-43b8-a6c9-a758e42b0017/serve-healthcheck-canary/0.log"
Jul 02 21:35:32.185422 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:32.185336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:32.185422 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:32.185417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:32.185877 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:32.185494    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:32.185877 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:32.185550    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:40.185537618 +0000 UTC m=+270.949068719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:32.185877 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:32.185494    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:32.189139 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:32.185942    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm podName:00421924-e802-4ebc-b9fe-8caa1900be66 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:40.185583362 +0000 UTC m=+270.949114465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8w44t" (UID: "00421924-e802-4ebc-b9fe-8caa1900be66") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:40.245277 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:40.245237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:40.245731 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:40.245342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:40.245898 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:40.245877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00421924-e802-4ebc-b9fe-8caa1900be66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:40.247577 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:40.247550    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00421924-e802-4ebc-b9fe-8caa1900be66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8w44t\" (UID: \"00421924-e802-4ebc-b9fe-8caa1900be66\") " pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:40.327307 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:40.327258    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8w44t"
Jul 02 21:35:40.447042 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:40.447011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8w44t"]
Jul 02 21:35:40.450113 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:35:40.450086    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00421924_e802_4ebc_b9fe_8caa1900be66.slice/crio-34a02dbd52b7fb9c5e31ccc8d1aaf58112b97ccff29cc13fcf0af1a7b69b4125 WatchSource:0}: Error finding container 34a02dbd52b7fb9c5e31ccc8d1aaf58112b97ccff29cc13fcf0af1a7b69b4125: Status 404 returned error can't find the container with id 34a02dbd52b7fb9c5e31ccc8d1aaf58112b97ccff29cc13fcf0af1a7b69b4125
Jul 02 21:35:40.638199 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:40.638158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8w44t" event={"ID":"00421924-e802-4ebc-b9fe-8caa1900be66","Type":"ContainerStarted","Data":"34a02dbd52b7fb9c5e31ccc8d1aaf58112b97ccff29cc13fcf0af1a7b69b4125"}
Jul 02 21:35:44.653443 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:44.653372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8w44t" event={"ID":"00421924-e802-4ebc-b9fe-8caa1900be66","Type":"ContainerStarted","Data":"c04a9745332749ca5323368d66309c57326028987e6d1f24a740fe7966b98c9a"}
Jul 02 21:35:45.659728 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:45.659688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8w44t" event={"ID":"00421924-e802-4ebc-b9fe-8caa1900be66","Type":"ContainerStarted","Data":"1a7e387f284e35775f7a9f437662b2c10f679be46f83d6f30052b45db90a2cf2"}
Jul 02 21:35:47.668882 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:47.668843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8w44t" event={"ID":"00421924-e802-4ebc-b9fe-8caa1900be66","Type":"ContainerStarted","Data":"c32945924cbbf97768699706b677aeecc849d00c87b5c270e6f5671357563261"}
Jul 02 21:35:47.691536 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:47.691480    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8w44t" podStartSLOduration=17.177621956 podStartE2EDuration="23.691461247s" totalImagesPullingTime="6.513839291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:35:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:47.69094143 +0000 UTC m=+278.454472551" watchObservedRunningTime="2026-07-02 21:35:47.691461247 +0000 UTC m=+278.454992367"
Jul 02 21:35:50.320919 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:50.320878    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tmr6x" podUID="d86fe2fe-825f-47f2-b0e5-5dbee05aa11a"
Jul 02 21:35:50.677187 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:50.677161    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:35:54.146793 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:54.146748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:35:54.148989 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:54.148960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86fe2fe-825f-47f2-b0e5-5dbee05aa11a-metrics-tls\") pod \"dns-default-tmr6x\" (UID: \"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a\") " pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:35:54.280455 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:54.280429    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-knz6t\""
Jul 02 21:35:54.288411 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:54.288387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:35:54.407414 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:54.407343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tmr6x"]
Jul 02 21:35:54.410523 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:35:54.410493    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86fe2fe_825f_47f2_b0e5_5dbee05aa11a.slice/crio-ba9f9abd9183a0b909657be33faab1cf9e68b09fab54e57edff6f1dfe228f14c WatchSource:0}: Error finding container ba9f9abd9183a0b909657be33faab1cf9e68b09fab54e57edff6f1dfe228f14c: Status 404 returned error can't find the container with id ba9f9abd9183a0b909657be33faab1cf9e68b09fab54e57edff6f1dfe228f14c
Jul 02 21:35:54.690065 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:54.689980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmr6x" event={"ID":"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a","Type":"ContainerStarted","Data":"ba9f9abd9183a0b909657be33faab1cf9e68b09fab54e57edff6f1dfe228f14c"}
Jul 02 21:35:56.697613 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:56.697578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmr6x" event={"ID":"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a","Type":"ContainerStarted","Data":"9c224dbccb99c8b739464599ded921ce0ca03d580595fca4644f53b47a65aa3d"}
Jul 02 21:35:56.697994 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:56.697627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmr6x" event={"ID":"d86fe2fe-825f-47f2-b0e5-5dbee05aa11a","Type":"ContainerStarted","Data":"242f0a6cb084a66d2bffc5a8ea7f9e6c670d2be5db4acc757210665c15280a94"}
Jul 02 21:35:56.697994 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:56.697716    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:35:56.715175 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:56.715128    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tmr6x" podStartSLOduration=251.086113926 podStartE2EDuration="4m12.715111198s" totalImagesPullingTime="1.628997272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:56.713673153 +0000 UTC m=+287.477204273" watchObservedRunningTime="2026-07-02 21:35:56.715111198 +0000 UTC m=+287.478642318"
Jul 02 21:35:58.324324 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.324292    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"]
Jul 02 21:35:58.326267 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.326251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.328758 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.328735    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 21:35:58.328869 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.328850    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8hhql\""
Jul 02 21:35:58.328998 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.328982    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 21:35:58.333567 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.333543    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 21:35:58.333714 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.333578    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 21:35:58.333714 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.333654    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 21:35:58.342974 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.342953    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"]
Jul 02 21:35:58.359480 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.359458    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4m4dv"]
Jul 02 21:35:58.361364 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.361349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.363671 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.363650    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 21:35:58.363833 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.363816    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 21:35:58.363896 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.363876    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vcgfq\""
Jul 02 21:35:58.364330 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.364313    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 21:35:58.377282 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.377254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m62k2\" (UniqueName: \"kubernetes.io/projected/1729cec6-1476-4357-be08-1a87ae637f46-kube-api-access-m62k2\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.377378 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.377290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1729cec6-1476-4357-be08-1a87ae637f46-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.377378 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.377353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.377479 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.377385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.478470 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m62k2\" (UniqueName: \"kubernetes.io/projected/1729cec6-1476-4357-be08-1a87ae637f46-kube-api-access-m62k2\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.478628 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.478628 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478628 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-wtmp\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478628 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-sys\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478628 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-root\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478800 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1729cec6-1476-4357-be08-1a87ae637f46-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.478800 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478800 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5057cd3-f9c4-4629-80b9-04dab4afb90b-metrics-client-ca\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478800 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-textfile\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478975 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-tls\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478975 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vkd\" (UniqueName: \"kubernetes.io/projected/d5057cd3-f9c4-4629-80b9-04dab4afb90b-kube-api-access-j6vkd\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.478975 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.478907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.479079 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:58.478994    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 02 21:35:58.479079 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:35:58.479046    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-tls podName:1729cec6-1476-4357-be08-1a87ae637f46 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:58.979029325 +0000 UTC m=+289.742560424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-s2f62" (UID: "1729cec6-1476-4357-be08-1a87ae637f46") : secret "openshift-state-metrics-tls" not found
Jul 02 21:35:58.479287 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.479273    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1729cec6-1476-4357-be08-1a87ae637f46-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.480814 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.480797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.489701 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.489676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m62k2\" (UniqueName: \"kubernetes.io/projected/1729cec6-1476-4357-be08-1a87ae637f46-kube-api-access-m62k2\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.580154 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580154 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-wtmp\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580358 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-sys\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580358 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-root\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580358 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580508 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580382    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-sys\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580508 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5057cd3-f9c4-4629-80b9-04dab4afb90b-metrics-client-ca\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580508 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580407    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-wtmp\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580508 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-textfile\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580508 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-tls\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580735 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vkd\" (UniqueName: \"kubernetes.io/projected/d5057cd3-f9c4-4629-80b9-04dab4afb90b-kube-api-access-j6vkd\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580784 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580840 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-textfile\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580894 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5057cd3-f9c4-4629-80b9-04dab4afb90b-root\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.580934 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.580908    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5057cd3-f9c4-4629-80b9-04dab4afb90b-metrics-client-ca\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.582736 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.582710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.582926 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.582905    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5057cd3-f9c4-4629-80b9-04dab4afb90b-node-exporter-tls\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.588537 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.588516    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vkd\" (UniqueName: \"kubernetes.io/projected/d5057cd3-f9c4-4629-80b9-04dab4afb90b-kube-api-access-j6vkd\") pod \"node-exporter-4m4dv\" (UID: \"d5057cd3-f9c4-4629-80b9-04dab4afb90b\") " pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.669960 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.669923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m4dv"
Jul 02 21:35:58.679071 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:35:58.679037    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5057cd3_f9c4_4629_80b9_04dab4afb90b.slice/crio-21ad90b37ada6b77977a18205b09125e8c41b07b679daa415f4a9dc846f845f9 WatchSource:0}: Error finding container 21ad90b37ada6b77977a18205b09125e8c41b07b679daa415f4a9dc846f845f9: Status 404 returned error can't find the container with id 21ad90b37ada6b77977a18205b09125e8c41b07b679daa415f4a9dc846f845f9
Jul 02 21:35:58.705392 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.705363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m4dv" event={"ID":"d5057cd3-f9c4-4629-80b9-04dab4afb90b","Type":"ContainerStarted","Data":"21ad90b37ada6b77977a18205b09125e8c41b07b679daa415f4a9dc846f845f9"}
Jul 02 21:35:58.982608 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.982571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:58.984871 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:58.984851    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1729cec6-1476-4357-be08-1a87ae637f46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s2f62\" (UID: \"1729cec6-1476-4357-be08-1a87ae637f46\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:59.238971 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:59.238883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"
Jul 02 21:35:59.379106 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:59.379071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62"]
Jul 02 21:35:59.505053 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:35:59.504979    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1729cec6_1476_4357_be08_1a87ae637f46.slice/crio-663f37795e1605e34c0d9ce71b7f348447ac23f7afea5ec1f4361e655b8bdbb4 WatchSource:0}: Error finding container 663f37795e1605e34c0d9ce71b7f348447ac23f7afea5ec1f4361e655b8bdbb4: Status 404 returned error can't find the container with id 663f37795e1605e34c0d9ce71b7f348447ac23f7afea5ec1f4361e655b8bdbb4
Jul 02 21:35:59.709621 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:59.709589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62" event={"ID":"1729cec6-1476-4357-be08-1a87ae637f46","Type":"ContainerStarted","Data":"6ca5d8c2cc1110f011a131e779166bd876ce1b9ff50ec8b7f760915e6cd93791"}
Jul 02 21:35:59.709795 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:59.709652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62" event={"ID":"1729cec6-1476-4357-be08-1a87ae637f46","Type":"ContainerStarted","Data":"508cb86136a1ecde7f9f610c83cd73de3ae31dd1783f76982d89af5b6d7085e6"}
Jul 02 21:35:59.709795 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:59.709684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62" event={"ID":"1729cec6-1476-4357-be08-1a87ae637f46","Type":"ContainerStarted","Data":"663f37795e1605e34c0d9ce71b7f348447ac23f7afea5ec1f4361e655b8bdbb4"}
Jul 02 21:35:59.711021 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:59.711000    2576 generic.go:356] "Generic (PLEG): container finished" podID="d5057cd3-f9c4-4629-80b9-04dab4afb90b" containerID="f17661dfc9f1c6dcc11f39a34176ca0ef6acb64d101654d3a1bba34d09bde17d" exitCode=0
Jul 02 21:35:59.711126 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:35:59.711040    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m4dv" event={"ID":"d5057cd3-f9c4-4629-80b9-04dab4afb90b","Type":"ContainerDied","Data":"f17661dfc9f1c6dcc11f39a34176ca0ef6acb64d101654d3a1bba34d09bde17d"}
Jul 02 21:36:00.717635 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:00.717603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m4dv" event={"ID":"d5057cd3-f9c4-4629-80b9-04dab4afb90b","Type":"ContainerStarted","Data":"f3c3bfd0b3ee08f4554e81c69cc4b6ddba78858f3d247688d4db20ae208f1282"}
Jul 02 21:36:00.717949 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:00.717703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m4dv" event={"ID":"d5057cd3-f9c4-4629-80b9-04dab4afb90b","Type":"ContainerStarted","Data":"8ad44463db6096c33ccf314755bfe96898e287422ba31719de97a4fbae354f7e"}
Jul 02 21:36:00.736077 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:00.736000    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4m4dv" podStartSLOduration=1.817294601 podStartE2EDuration="2.735987169s" totalImagesPullingTime="847.204633ms" totalInitContainerRuntime="71.487935ms" isStatefulPod=true podCreationTimestamp="2026-07-02 21:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:00.735124319 +0000 UTC m=+291.498655436" watchObservedRunningTime="2026-07-02 21:36:00.735987169 +0000 UTC m=+291.499518267"
Jul 02 21:36:01.723438 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:01.723404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62" event={"ID":"1729cec6-1476-4357-be08-1a87ae637f46","Type":"ContainerStarted","Data":"86cf6f334d0b04ec8d31fcf6f2e4e248cda5673999d66983893d9e7882390d97"}
Jul 02 21:36:01.740682 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:01.740637    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s2f62" podStartSLOduration=2.6754112599999997 podStartE2EDuration="3.740620601s" totalImagesPullingTime="1.065209341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:01.739345017 +0000 UTC m=+292.502876138" watchObservedRunningTime="2026-07-02 21:36:01.740620601 +0000 UTC m=+292.504151720"
Jul 02 21:36:02.823961 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:36:02.823923    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5brlj" podUID="2c71f14d-4178-48a4-a229-16e98c2fe8ba"
Jul 02 21:36:03.105293 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.105196    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"]
Jul 02 21:36:03.108366 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.108349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:03.110584 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.110564    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 21:36:03.110693 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.110667    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ztwjp\""
Jul 02 21:36:03.115900 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.115876    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"]
Jul 02 21:36:03.217236 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.217173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c86d2faf-3311-4101-bac1-ae780ade8382-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lv9nt\" (UID: \"c86d2faf-3311-4101-bac1-ae780ade8382\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:03.217416 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.217251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqxdk\" (UniqueName: \"kubernetes.io/projected/c86d2faf-3311-4101-bac1-ae780ade8382-kube-api-access-vqxdk\") pod \"monitoring-plugin-d5dcff7cf-lv9nt\" (UID: \"c86d2faf-3311-4101-bac1-ae780ade8382\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:03.318436 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.318407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c86d2faf-3311-4101-bac1-ae780ade8382-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lv9nt\" (UID: \"c86d2faf-3311-4101-bac1-ae780ade8382\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:03.318560 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.318449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqxdk\" (UniqueName: \"kubernetes.io/projected/c86d2faf-3311-4101-bac1-ae780ade8382-kube-api-access-vqxdk\") pod \"monitoring-plugin-d5dcff7cf-lv9nt\" (UID: \"c86d2faf-3311-4101-bac1-ae780ade8382\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:03.318611 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:36:03.318553    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 02 21:36:03.318644 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:36:03.318618    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86d2faf-3311-4101-bac1-ae780ade8382-monitoring-plugin-cert podName:c86d2faf-3311-4101-bac1-ae780ade8382 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:03.818601017 +0000 UTC m=+294.582132116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c86d2faf-3311-4101-bac1-ae780ade8382-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-lv9nt" (UID: "c86d2faf-3311-4101-bac1-ae780ade8382") : secret "monitoring-plugin-cert" not found
Jul 02 21:36:03.328441 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.328415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqxdk\" (UniqueName: \"kubernetes.io/projected/c86d2faf-3311-4101-bac1-ae780ade8382-kube-api-access-vqxdk\") pod \"monitoring-plugin-d5dcff7cf-lv9nt\" (UID: \"c86d2faf-3311-4101-bac1-ae780ade8382\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:03.822625 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.822580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c86d2faf-3311-4101-bac1-ae780ade8382-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lv9nt\" (UID: \"c86d2faf-3311-4101-bac1-ae780ade8382\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:03.827434 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:03.827408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c86d2faf-3311-4101-bac1-ae780ade8382-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lv9nt\" (UID: \"c86d2faf-3311-4101-bac1-ae780ade8382\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:04.018269 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:04.018241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:04.140694 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:04.140672    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"]
Jul 02 21:36:04.142621 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:36:04.142593    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86d2faf_3311_4101_bac1_ae780ade8382.slice/crio-2a1b8ef4691c7dd720afd6fc34a9acac34cde010c80d8a4c67b9b3e347b8a9eb WatchSource:0}: Error finding container 2a1b8ef4691c7dd720afd6fc34a9acac34cde010c80d8a4c67b9b3e347b8a9eb: Status 404 returned error can't find the container with id 2a1b8ef4691c7dd720afd6fc34a9acac34cde010c80d8a4c67b9b3e347b8a9eb
Jul 02 21:36:04.733927 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:04.733891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt" event={"ID":"c86d2faf-3311-4101-bac1-ae780ade8382","Type":"ContainerStarted","Data":"2a1b8ef4691c7dd720afd6fc34a9acac34cde010c80d8a4c67b9b3e347b8a9eb"}
Jul 02 21:36:05.737935 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:05.737902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt" event={"ID":"c86d2faf-3311-4101-bac1-ae780ade8382","Type":"ContainerStarted","Data":"ac3f10e30828cb56f5d8cbd61333d49748e955b43bcc51b05651658c77972a6f"}
Jul 02 21:36:05.738322 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:05.738098    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:05.743106 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:05.743088    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt"
Jul 02 21:36:05.754619 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:05.754583    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lv9nt" podStartSLOduration=1.270820274 podStartE2EDuration="2.754570062s" totalImagesPullingTime="1.483749788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:05.753558936 +0000 UTC m=+296.517090057" watchObservedRunningTime="2026-07-02 21:36:05.754570062 +0000 UTC m=+296.518101182"
Jul 02 21:36:06.703109 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:06.703079    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tmr6x"
Jul 02 21:36:09.654184 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:09.654157    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 21:36:13.822350 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:13.822314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:36:51.637352 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:36:51.637306    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" podUID="ddd2f31a-1f61-477a-b143-0573663b3652" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 02 21:37:01.637194 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:01.637111    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" podUID="ddd2f31a-1f61-477a-b143-0573663b3652" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 02 21:37:11.637617 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:11.637578    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" podUID="ddd2f31a-1f61-477a-b143-0573663b3652" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 02 21:37:11.637990 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:11.637658    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx"
Jul 02 21:37:11.638129 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:11.638099    2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e65957b5f856cefeccd7661dd34b9475dc2096a76ccbb59548d7580754fb7a9e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 02 21:37:11.638166 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:11.638149    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" podUID="ddd2f31a-1f61-477a-b143-0573663b3652" containerName="service-proxy" containerID="cri-o://e65957b5f856cefeccd7661dd34b9475dc2096a76ccbb59548d7580754fb7a9e" gracePeriod=30
Jul 02 21:37:11.951824 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:11.951738    2576 generic.go:356] "Generic (PLEG): container finished" podID="ddd2f31a-1f61-477a-b143-0573663b3652" containerID="e65957b5f856cefeccd7661dd34b9475dc2096a76ccbb59548d7580754fb7a9e" exitCode=2
Jul 02 21:37:11.951824 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:11.951783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" event={"ID":"ddd2f31a-1f61-477a-b143-0573663b3652","Type":"ContainerDied","Data":"e65957b5f856cefeccd7661dd34b9475dc2096a76ccbb59548d7580754fb7a9e"}
Jul 02 21:37:11.951824 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:11.951814    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb9bbcd96-cn6vx" event={"ID":"ddd2f31a-1f61-477a-b143-0573663b3652","Type":"ContainerStarted","Data":"6b51ccbf6810493d45afe1f07116a944fad06e52cfb9eeeebf47eaed9be4785b"}
Jul 02 21:37:23.614603 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:23.614550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:37:23.616821 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:23.616799    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c71f14d-4178-48a4-a229-16e98c2fe8ba-metrics-certs\") pod \"network-metrics-daemon-5brlj\" (UID: \"2c71f14d-4178-48a4-a229-16e98c2fe8ba\") " pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:37:23.725515 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:23.725491    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7x7kj\""
Jul 02 21:37:23.733449 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:23.733431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brlj"
Jul 02 21:37:23.850227 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:23.850186    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5brlj"]
Jul 02 21:37:23.853108 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:37:23.853084    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c71f14d_4178_48a4_a229_16e98c2fe8ba.slice/crio-945a1299280c860375d256835d0d8164a0ffda9f8e51414f94b67d72d2d586ff WatchSource:0}: Error finding container 945a1299280c860375d256835d0d8164a0ffda9f8e51414f94b67d72d2d586ff: Status 404 returned error can't find the container with id 945a1299280c860375d256835d0d8164a0ffda9f8e51414f94b67d72d2d586ff
Jul 02 21:37:23.855025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:23.855006    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:37:23.989387 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:23.989353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5brlj" event={"ID":"2c71f14d-4178-48a4-a229-16e98c2fe8ba","Type":"ContainerStarted","Data":"945a1299280c860375d256835d0d8164a0ffda9f8e51414f94b67d72d2d586ff"}
Jul 02 21:37:24.994476 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:24.994396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5brlj" event={"ID":"2c71f14d-4178-48a4-a229-16e98c2fe8ba","Type":"ContainerStarted","Data":"e663f6b732e0af678a45703c48adc614a4ced77513fdbe6e73ed941a53ee725a"}
Jul 02 21:37:24.994476 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:24.994449    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5brlj" event={"ID":"2c71f14d-4178-48a4-a229-16e98c2fe8ba","Type":"ContainerStarted","Data":"400ce9017835c7ac0262786c65ca42ff9b8042577abbaa997ced60b80ec99cf1"}
Jul 02 21:37:25.009905 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:37:25.009855    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5brlj" podStartSLOduration=374.159196805 podStartE2EDuration="6m15.009840565s" totalImagesPullingTime="850.64376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:25.009129155 +0000 UTC m=+375.772660276" watchObservedRunningTime="2026-07-02 21:37:25.009840565 +0000 UTC m=+375.773371684"
Jul 02 21:43:42.181387 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.181357    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"]
Jul 02 21:43:42.184253 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.184237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.186557 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.186529    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 02 21:43:42.186691 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.186620    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:43:42.186691 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.186633    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-chrzl\""
Jul 02 21:43:42.206382 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.206353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"]
Jul 02 21:43:42.332890 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.332847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f364466a-d13e-44cd-96f9-04cfd9251733-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4wtcz\" (UID: \"f364466a-d13e-44cd-96f9-04cfd9251733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.333066 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.332902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngzr6\" (UniqueName: \"kubernetes.io/projected/f364466a-d13e-44cd-96f9-04cfd9251733-kube-api-access-ngzr6\") pod \"cert-manager-operator-controller-manager-55c444bf86-4wtcz\" (UID: \"f364466a-d13e-44cd-96f9-04cfd9251733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.433628 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.433534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f364466a-d13e-44cd-96f9-04cfd9251733-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4wtcz\" (UID: \"f364466a-d13e-44cd-96f9-04cfd9251733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.433628 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.433591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngzr6\" (UniqueName: \"kubernetes.io/projected/f364466a-d13e-44cd-96f9-04cfd9251733-kube-api-access-ngzr6\") pod \"cert-manager-operator-controller-manager-55c444bf86-4wtcz\" (UID: \"f364466a-d13e-44cd-96f9-04cfd9251733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.433913 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.433894    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f364466a-d13e-44cd-96f9-04cfd9251733-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4wtcz\" (UID: \"f364466a-d13e-44cd-96f9-04cfd9251733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.442944 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.442917    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngzr6\" (UniqueName: \"kubernetes.io/projected/f364466a-d13e-44cd-96f9-04cfd9251733-kube-api-access-ngzr6\") pod \"cert-manager-operator-controller-manager-55c444bf86-4wtcz\" (UID: \"f364466a-d13e-44cd-96f9-04cfd9251733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.492787 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.492752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"
Jul 02 21:43:42.619904 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.619883    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz"]
Jul 02 21:43:42.622305 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:43:42.622267    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf364466a_d13e_44cd_96f9_04cfd9251733.slice/crio-fae43cf44131f4814265e910afae7adb8c3c5bbcb8c1325769e69e143b46ce57 WatchSource:0}: Error finding container fae43cf44131f4814265e910afae7adb8c3c5bbcb8c1325769e69e143b46ce57: Status 404 returned error can't find the container with id fae43cf44131f4814265e910afae7adb8c3c5bbcb8c1325769e69e143b46ce57
Jul 02 21:43:42.624789 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:42.624771    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:43:43.210509 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:43.210468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz" event={"ID":"f364466a-d13e-44cd-96f9-04cfd9251733","Type":"ContainerStarted","Data":"fae43cf44131f4814265e910afae7adb8c3c5bbcb8c1325769e69e143b46ce57"}
Jul 02 21:43:45.218814 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:45.218778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz" event={"ID":"f364466a-d13e-44cd-96f9-04cfd9251733","Type":"ContainerStarted","Data":"31414393b963539eb7a3ca27e52dd3881107257135c6eabc03bb1b63875920b7"}
Jul 02 21:43:45.256338 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:45.256228    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4wtcz" podStartSLOduration=0.876343842 podStartE2EDuration="3.256191227s" totalImagesPullingTime="2.379847385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:43:45.255020414 +0000 UTC m=+756.018551570" watchObservedRunningTime="2026-07-02 21:43:45.256191227 +0000 UTC m=+756.019722350"
Jul 02 21:43:53.573833 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.573799    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mkjtc"]
Jul 02 21:43:53.576980 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.576963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:53.579506 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.579475    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 21:43:53.579615 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.579558    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 21:43:53.580253 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.580230    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hwftt\""
Jul 02 21:43:53.585798 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.585778    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mkjtc"]
Jul 02 21:43:53.716485 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.716430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjqh\" (UniqueName: \"kubernetes.io/projected/1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b-kube-api-access-5gjqh\") pod \"cert-manager-webhook-6486ffd997-mkjtc\" (UID: \"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:53.716668 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.716551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mkjtc\" (UID: \"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:53.817478 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.817432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mkjtc\" (UID: \"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:53.817645 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.817487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjqh\" (UniqueName: \"kubernetes.io/projected/1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b-kube-api-access-5gjqh\") pod \"cert-manager-webhook-6486ffd997-mkjtc\" (UID: \"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:53.825850 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.825783    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mkjtc\" (UID: \"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:53.825850 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.825815    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjqh\" (UniqueName: \"kubernetes.io/projected/1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b-kube-api-access-5gjqh\") pod \"cert-manager-webhook-6486ffd997-mkjtc\" (UID: \"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:53.886568 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:53.886525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:54.009653 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:54.009626    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mkjtc"]
Jul 02 21:43:54.012003 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:43:54.011974    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b1ea9a4_1c9e_4a42_8e0d_ae963c0c164b.slice/crio-99a3d0420681779ac18a957501c27bf0ab80a28a257cee8c857473e86bf086af WatchSource:0}: Error finding container 99a3d0420681779ac18a957501c27bf0ab80a28a257cee8c857473e86bf086af: Status 404 returned error can't find the container with id 99a3d0420681779ac18a957501c27bf0ab80a28a257cee8c857473e86bf086af
Jul 02 21:43:54.250247 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:54.250190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc" event={"ID":"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b","Type":"ContainerStarted","Data":"99a3d0420681779ac18a957501c27bf0ab80a28a257cee8c857473e86bf086af"}
Jul 02 21:43:57.262270 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:57.262236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc" event={"ID":"1b1ea9a4-1c9e-4a42-8e0d-ae963c0c164b","Type":"ContainerStarted","Data":"ef5229e9768d294dfd622dd3dbb5343eeb373c64fcd0b93d1f14db85fe369d93"}
Jul 02 21:43:57.262648 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:57.262351    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:43:57.278294 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:43:57.278251    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc" podStartSLOduration=1.745502121 podStartE2EDuration="4.278237391s" totalImagesPullingTime="2.53273527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:43:57.277121023 +0000 UTC m=+768.040652144" watchObservedRunningTime="2026-07-02 21:43:57.278237391 +0000 UTC m=+768.041768510"
Jul 02 21:44:03.267854 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:03.267822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mkjtc"
Jul 02 21:44:06.441568 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.441531    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sfvdx"]
Jul 02 21:44:06.444425 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.444409    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.447368 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.447351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7pmqv\""
Jul 02 21:44:06.456221 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.456188    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sfvdx"]
Jul 02 21:44:06.613538 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.613501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqckk\" (UniqueName: \"kubernetes.io/projected/4c99911c-65d8-4440-acc4-4235dbbd0718-kube-api-access-rqckk\") pod \"cert-manager-55b4d954d5-sfvdx\" (UID: \"4c99911c-65d8-4440-acc4-4235dbbd0718\") " pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.613736 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.613565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c99911c-65d8-4440-acc4-4235dbbd0718-bound-sa-token\") pod \"cert-manager-55b4d954d5-sfvdx\" (UID: \"4c99911c-65d8-4440-acc4-4235dbbd0718\") " pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.714599 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.714510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqckk\" (UniqueName: \"kubernetes.io/projected/4c99911c-65d8-4440-acc4-4235dbbd0718-kube-api-access-rqckk\") pod \"cert-manager-55b4d954d5-sfvdx\" (UID: \"4c99911c-65d8-4440-acc4-4235dbbd0718\") " pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.714599 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.714575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c99911c-65d8-4440-acc4-4235dbbd0718-bound-sa-token\") pod \"cert-manager-55b4d954d5-sfvdx\" (UID: \"4c99911c-65d8-4440-acc4-4235dbbd0718\") " pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.722811 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.722785    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c99911c-65d8-4440-acc4-4235dbbd0718-bound-sa-token\") pod \"cert-manager-55b4d954d5-sfvdx\" (UID: \"4c99911c-65d8-4440-acc4-4235dbbd0718\") " pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.722971 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.722854    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqckk\" (UniqueName: \"kubernetes.io/projected/4c99911c-65d8-4440-acc4-4235dbbd0718-kube-api-access-rqckk\") pod \"cert-manager-55b4d954d5-sfvdx\" (UID: \"4c99911c-65d8-4440-acc4-4235dbbd0718\") " pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.752418 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.752386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sfvdx"
Jul 02 21:44:06.876938 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:06.876864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sfvdx"]
Jul 02 21:44:06.879414 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:44:06.879372    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c99911c_65d8_4440_acc4_4235dbbd0718.slice/crio-7fbb3b2c3f16d411a164ecd900b9203162ff67031b7c2f574162484dc5a7cece WatchSource:0}: Error finding container 7fbb3b2c3f16d411a164ecd900b9203162ff67031b7c2f574162484dc5a7cece: Status 404 returned error can't find the container with id 7fbb3b2c3f16d411a164ecd900b9203162ff67031b7c2f574162484dc5a7cece
Jul 02 21:44:07.299290 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:07.299256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sfvdx" event={"ID":"4c99911c-65d8-4440-acc4-4235dbbd0718","Type":"ContainerStarted","Data":"26f74240da376f7181dad2d435f58777607e0639b4e1ac0f9b325cfa98bdcfe4"}
Jul 02 21:44:07.299458 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:07.299301    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sfvdx" event={"ID":"4c99911c-65d8-4440-acc4-4235dbbd0718","Type":"ContainerStarted","Data":"7fbb3b2c3f16d411a164ecd900b9203162ff67031b7c2f574162484dc5a7cece"}
Jul 02 21:44:07.313793 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:07.313736    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-sfvdx" podStartSLOduration=1.313715882 podStartE2EDuration="1.313715882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:07.313648207 +0000 UTC m=+778.077179324" watchObservedRunningTime="2026-07-02 21:44:07.313715882 +0000 UTC m=+778.077246999"
Jul 02 21:44:17.536349 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.536315    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"]
Jul 02 21:44:17.539695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.539677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.544560 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.544499    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 21:44:17.544706 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.544587    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 21:44:17.544886 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.544834    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9ghtb\""
Jul 02 21:44:17.544952 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.544884    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 21:44:17.545288 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.545267    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 21:44:17.561830 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.561808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"]
Jul 02 21:44:17.696827 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.696793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgg9x\" (UniqueName: \"kubernetes.io/projected/7ab74886-b86d-44b0-9f99-e181584e667a-kube-api-access-fgg9x\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.696827 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.696829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ab74886-b86d-44b0-9f99-e181584e667a-manifests\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.697064 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.696848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74886-b86d-44b0-9f99-e181584e667a-tmp\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.697064 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.696995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ab74886-b86d-44b0-9f99-e181584e667a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.697064 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.697035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ab74886-b86d-44b0-9f99-e181584e667a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.797590 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.797511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ab74886-b86d-44b0-9f99-e181584e667a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.797590 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.797545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ab74886-b86d-44b0-9f99-e181584e667a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.797590 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.797570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgg9x\" (UniqueName: \"kubernetes.io/projected/7ab74886-b86d-44b0-9f99-e181584e667a-kube-api-access-fgg9x\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.797781 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.797621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ab74886-b86d-44b0-9f99-e181584e667a-manifests\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.797781 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.797654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74886-b86d-44b0-9f99-e181584e667a-tmp\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.798160 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.798140    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ab74886-b86d-44b0-9f99-e181584e667a-manifests\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.799876 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.799854    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74886-b86d-44b0-9f99-e181584e667a-tmp\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.799987 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.799972    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ab74886-b86d-44b0-9f99-e181584e667a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.800029 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.799995    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ab74886-b86d-44b0-9f99-e181584e667a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.811797 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.811778    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgg9x\" (UniqueName: \"kubernetes.io/projected/7ab74886-b86d-44b0-9f99-e181584e667a-kube-api-access-fgg9x\") pod \"opendatahub-operator-controller-manager-6c4697655-6m8ms\" (UID: \"7ab74886-b86d-44b0-9f99-e181584e667a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.853645 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.853614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:17.991391 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:17.991369    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"]
Jul 02 21:44:17.993740 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:44:17.993714    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab74886_b86d_44b0_9f99_e181584e667a.slice/crio-7d5ce3d3c16b29835ad8b3c246efa0708f40931b1a76a69ebffbffd09407c86a WatchSource:0}: Error finding container 7d5ce3d3c16b29835ad8b3c246efa0708f40931b1a76a69ebffbffd09407c86a: Status 404 returned error can't find the container with id 7d5ce3d3c16b29835ad8b3c246efa0708f40931b1a76a69ebffbffd09407c86a
Jul 02 21:44:18.338504 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:18.338465    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms" event={"ID":"7ab74886-b86d-44b0-9f99-e181584e667a","Type":"ContainerStarted","Data":"7d5ce3d3c16b29835ad8b3c246efa0708f40931b1a76a69ebffbffd09407c86a"}
Jul 02 21:44:21.354053 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:21.353976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms" event={"ID":"7ab74886-b86d-44b0-9f99-e181584e667a","Type":"ContainerStarted","Data":"a58f04ef86d223f5bad556262e8b47bf2cd68d1f4ecd353c961eb916d4d23796"}
Jul 02 21:44:22.360224 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:22.360122    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ab74886-b86d-44b0-9f99-e181584e667a" containerID="a58f04ef86d223f5bad556262e8b47bf2cd68d1f4ecd353c961eb916d4d23796" exitCode=0
Jul 02 21:44:22.360224 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:22.360159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms" event={"ID":"7ab74886-b86d-44b0-9f99-e181584e667a","Type":"ContainerDied","Data":"a58f04ef86d223f5bad556262e8b47bf2cd68d1f4ecd353c961eb916d4d23796"}
Jul 02 21:44:23.367039 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:23.366997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms" event={"ID":"7ab74886-b86d-44b0-9f99-e181584e667a","Type":"ContainerStarted","Data":"81ba1c49c8301368277bab62ad9db0f5648c065d5f0962ad6dea7c9fd99aef32"}
Jul 02 21:44:23.367518 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:23.367130    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:23.401942 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:23.401894    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms" podStartSLOduration=2.073733115 podStartE2EDuration="6.401877162s" totalImagesPullingTime="3.229870797s" totalInitContainerRuntime="1.09827325s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:23.400327324 +0000 UTC m=+794.163858443" watchObservedRunningTime="2026-07-02 21:44:23.401877162 +0000 UTC m=+794.165408281"
Jul 02 21:44:34.372497 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:34.372428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-6m8ms"
Jul 02 21:44:38.716521 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.716486    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"]
Jul 02 21:44:38.719404 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.719388    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.724226 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.724166    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 21:44:38.724226 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.724195    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 21:44:38.724383 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.724244    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nzzzz\""
Jul 02 21:44:38.724383 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.724367    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 21:44:38.724490 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.724411    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 21:44:38.753234 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.753182    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"]
Jul 02 21:44:38.763308 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.763285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d977dd7-c20c-4217-9a84-4da38e9b211e-tls-certs\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.763453 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.763343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8cpj\" (UniqueName: \"kubernetes.io/projected/5d977dd7-c20c-4217-9a84-4da38e9b211e-kube-api-access-r8cpj\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.763453 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.763423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d977dd7-c20c-4217-9a84-4da38e9b211e-tmp\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.864779 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.864741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d977dd7-c20c-4217-9a84-4da38e9b211e-tmp\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.864952 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.864789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d977dd7-c20c-4217-9a84-4da38e9b211e-tls-certs\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.864952 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.864827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8cpj\" (UniqueName: \"kubernetes.io/projected/5d977dd7-c20c-4217-9a84-4da38e9b211e-kube-api-access-r8cpj\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.866961 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.866927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d977dd7-c20c-4217-9a84-4da38e9b211e-tmp\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.867232 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.867195    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d977dd7-c20c-4217-9a84-4da38e9b211e-tls-certs\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:38.901638 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:38.901610    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8cpj\" (UniqueName: \"kubernetes.io/projected/5d977dd7-c20c-4217-9a84-4da38e9b211e-kube-api-access-r8cpj\") pod \"kube-auth-proxy-6d45cbf66b-2cclq\" (UID: \"5d977dd7-c20c-4217-9a84-4da38e9b211e\") " pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:39.029133 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:39.029054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"
Jul 02 21:44:39.154040 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:39.153993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq"]
Jul 02 21:44:39.157439 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:44:39.157403    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d977dd7_c20c_4217_9a84_4da38e9b211e.slice/crio-fa07d7dff0c7ce380ef8da534297fa0cba2f358c17a19337aa1619315733ebb5 WatchSource:0}: Error finding container fa07d7dff0c7ce380ef8da534297fa0cba2f358c17a19337aa1619315733ebb5: Status 404 returned error can't find the container with id fa07d7dff0c7ce380ef8da534297fa0cba2f358c17a19337aa1619315733ebb5
Jul 02 21:44:39.426351 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:39.426322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq" event={"ID":"5d977dd7-c20c-4217-9a84-4da38e9b211e","Type":"ContainerStarted","Data":"fa07d7dff0c7ce380ef8da534297fa0cba2f358c17a19337aa1619315733ebb5"}
Jul 02 21:44:42.440459 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.440418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq" event={"ID":"5d977dd7-c20c-4217-9a84-4da38e9b211e","Type":"ContainerStarted","Data":"67e2ff89456216248a5d9183e2f0a6c4a9cd2f189469d8991dae0a12cb38e314"}
Jul 02 21:44:42.460184 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.460136    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d45cbf66b-2cclq" podStartSLOduration=1.835081559 podStartE2EDuration="4.460119511s" totalImagesPullingTime="2.625037952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:42.458849598 +0000 UTC m=+813.222380720" watchObservedRunningTime="2026-07-02 21:44:42.460119511 +0000 UTC m=+813.223650630"
Jul 02 21:44:42.768414 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.768327    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"]
Jul 02 21:44:42.771468 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.771446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.774477 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.774451    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 21:44:42.774622 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.774459    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 21:44:42.774622 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.774496    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:44:42.774622 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.774565    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t9ltp\""
Jul 02 21:44:42.774778 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.774705    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 21:44:42.775044 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.775030    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 21:44:42.785231 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.785194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"]
Jul 02 21:44:42.896004 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.895974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9xpt\" (UniqueName: \"kubernetes.io/projected/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-kube-api-access-g9xpt\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.896004 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.896009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-cert\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.896225 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.896043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-manager-config\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.896225 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.896071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-metrics-cert\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.997372 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.997335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-metrics-cert\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.997534 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.997397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9xpt\" (UniqueName: \"kubernetes.io/projected/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-kube-api-access-g9xpt\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.997534 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.997420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-cert\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.997534 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.997456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-manager-config\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.998132 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.998108    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-manager-config\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.999843 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.999821    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-metrics-cert\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:42.999935 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:42.999853    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-cert\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:43.007745 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:43.007717    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9xpt\" (UniqueName: \"kubernetes.io/projected/d54a2a55-1fea-4a7c-ab6c-4265eb16dc00-kube-api-access-g9xpt\") pod \"lws-controller-manager-bb99d9bb4-nwp5t\" (UID: \"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:43.080966 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:43.080899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:43.205918 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:43.205858    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"]
Jul 02 21:44:43.208289 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:44:43.208266    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54a2a55_1fea_4a7c_ab6c_4265eb16dc00.slice/crio-f229f94800acd830a15aa245dd71ad31f8bd3a8a5cc7d67782541318f77b87bd WatchSource:0}: Error finding container f229f94800acd830a15aa245dd71ad31f8bd3a8a5cc7d67782541318f77b87bd: Status 404 returned error can't find the container with id f229f94800acd830a15aa245dd71ad31f8bd3a8a5cc7d67782541318f77b87bd
Jul 02 21:44:43.445514 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:43.445472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t" event={"ID":"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00","Type":"ContainerStarted","Data":"f229f94800acd830a15aa245dd71ad31f8bd3a8a5cc7d67782541318f77b87bd"}
Jul 02 21:44:46.461554 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:46.461521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t" event={"ID":"d54a2a55-1fea-4a7c-ab6c-4265eb16dc00","Type":"ContainerStarted","Data":"d8cace916159a5375ad0d5640c91587998cd3dd6def73a57c074eb7345c1d486"}
Jul 02 21:44:46.461939 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:46.461661    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:44:46.487771 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:46.487720    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t" podStartSLOduration=1.999470968 podStartE2EDuration="4.487705341s" totalImagesPullingTime="2.488234373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:46.485799387 +0000 UTC m=+817.249330507" watchObservedRunningTime="2026-07-02 21:44:46.487705341 +0000 UTC m=+817.251236460"
Jul 02 21:44:57.467607 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:44:57.467575    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-nwp5t"
Jul 02 21:47:12.765545 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.765511    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:47:12.768732 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.768715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:12.771227 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.771186    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 21:47:12.771353 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.771262    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 21:47:12.772248 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.772230    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 21:47:12.772248 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.772241    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lsjvq\""
Jul 02 21:47:12.778859 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.778835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:47:12.812984 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.812951    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:47:12.822111 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.822085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92857d9f-2fa5-4cb3-9d02-0cc84028e9c0-config-file\") pod \"limitador-limitador-54d6d988d5-znrmg\" (UID: \"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:12.822274 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.822126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjttl\" (UniqueName: \"kubernetes.io/projected/92857d9f-2fa5-4cb3-9d02-0cc84028e9c0-kube-api-access-vjttl\") pod \"limitador-limitador-54d6d988d5-znrmg\" (UID: \"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:12.923113 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.923078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92857d9f-2fa5-4cb3-9d02-0cc84028e9c0-config-file\") pod \"limitador-limitador-54d6d988d5-znrmg\" (UID: \"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:12.923335 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.923126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjttl\" (UniqueName: \"kubernetes.io/projected/92857d9f-2fa5-4cb3-9d02-0cc84028e9c0-kube-api-access-vjttl\") pod \"limitador-limitador-54d6d988d5-znrmg\" (UID: \"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:12.923792 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.923765    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92857d9f-2fa5-4cb3-9d02-0cc84028e9c0-config-file\") pod \"limitador-limitador-54d6d988d5-znrmg\" (UID: \"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:12.938917 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:12.938887    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjttl\" (UniqueName: \"kubernetes.io/projected/92857d9f-2fa5-4cb3-9d02-0cc84028e9c0-kube-api-access-vjttl\") pod \"limitador-limitador-54d6d988d5-znrmg\" (UID: \"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:13.079425 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.079342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:13.208858 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.208757    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:47:13.211497 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:47:13.211469    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92857d9f_2fa5_4cb3_9d02_0cc84028e9c0.slice/crio-403c80b6fd03342963643fd74deee75c74cc9313177c54307df7e3b6f789ed0b WatchSource:0}: Error finding container 403c80b6fd03342963643fd74deee75c74cc9313177c54307df7e3b6f789ed0b: Status 404 returned error can't find the container with id 403c80b6fd03342963643fd74deee75c74cc9313177c54307df7e3b6f789ed0b
Jul 02 21:47:13.610120 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.610091    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-z62wt"]
Jul 02 21:47:13.614269 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.614248    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z62wt"
Jul 02 21:47:13.616749 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.616732    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-26fc8\""
Jul 02 21:47:13.621166 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.621141    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z62wt"]
Jul 02 21:47:13.627225 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.627192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th4bq\" (UniqueName: \"kubernetes.io/projected/163b6f0f-5fc8-4c53-b90a-e748a7fceca6-kube-api-access-th4bq\") pod \"authorino-75d556bd77-z62wt\" (UID: \"163b6f0f-5fc8-4c53-b90a-e748a7fceca6\") " pod="kuadrant-system/authorino-75d556bd77-z62wt"
Jul 02 21:47:13.728653 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.728351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4bq\" (UniqueName: \"kubernetes.io/projected/163b6f0f-5fc8-4c53-b90a-e748a7fceca6-kube-api-access-th4bq\") pod \"authorino-75d556bd77-z62wt\" (UID: \"163b6f0f-5fc8-4c53-b90a-e748a7fceca6\") " pod="kuadrant-system/authorino-75d556bd77-z62wt"
Jul 02 21:47:13.737025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.736975    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th4bq\" (UniqueName: \"kubernetes.io/projected/163b6f0f-5fc8-4c53-b90a-e748a7fceca6-kube-api-access-th4bq\") pod \"authorino-75d556bd77-z62wt\" (UID: \"163b6f0f-5fc8-4c53-b90a-e748a7fceca6\") " pod="kuadrant-system/authorino-75d556bd77-z62wt"
Jul 02 21:47:13.924624 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:13.924593    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z62wt"
Jul 02 21:47:14.024534 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:14.024496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg" event={"ID":"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0","Type":"ContainerStarted","Data":"403c80b6fd03342963643fd74deee75c74cc9313177c54307df7e3b6f789ed0b"}
Jul 02 21:47:14.108782 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:14.108747    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z62wt"]
Jul 02 21:47:14.111726 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:47:14.111690    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod163b6f0f_5fc8_4c53_b90a_e748a7fceca6.slice/crio-5fa5f12fa098ae7a84a4453475e83324ebf81681a2a6344e7b858f7ca89e7e1f WatchSource:0}: Error finding container 5fa5f12fa098ae7a84a4453475e83324ebf81681a2a6344e7b858f7ca89e7e1f: Status 404 returned error can't find the container with id 5fa5f12fa098ae7a84a4453475e83324ebf81681a2a6344e7b858f7ca89e7e1f
Jul 02 21:47:15.035813 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:15.035772    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z62wt" event={"ID":"163b6f0f-5fc8-4c53-b90a-e748a7fceca6","Type":"ContainerStarted","Data":"5fa5f12fa098ae7a84a4453475e83324ebf81681a2a6344e7b858f7ca89e7e1f"}
Jul 02 21:47:16.043426 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:16.043367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg" event={"ID":"92857d9f-2fa5-4cb3-9d02-0cc84028e9c0","Type":"ContainerStarted","Data":"41a2a610695fdbd99da9374c902c553dd03517c2f9ebe42f9f142334f31227e7"}
Jul 02 21:47:16.044072 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:16.044002    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:16.061322 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:16.061271    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg" podStartSLOduration=1.47946868 podStartE2EDuration="4.06125712s" totalImagesPullingTime="2.58178844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:47:16.059857591 +0000 UTC m=+966.823388718" watchObservedRunningTime="2026-07-02 21:47:16.06125712 +0000 UTC m=+966.824788240"
Jul 02 21:47:19.058036 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:19.057946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z62wt" event={"ID":"163b6f0f-5fc8-4c53-b90a-e748a7fceca6","Type":"ContainerStarted","Data":"51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f"}
Jul 02 21:47:19.076191 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:19.076144    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-z62wt" podStartSLOduration=1.5048111149999999 podStartE2EDuration="6.07612592s" totalImagesPullingTime="4.571314805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:47:19.074747991 +0000 UTC m=+969.838279111" watchObservedRunningTime="2026-07-02 21:47:19.07612592 +0000 UTC m=+969.839657040"
Jul 02 21:47:28.053778 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:28.053749    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-znrmg"
Jul 02 21:47:47.610898 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:47.610813    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z62wt"]
Jul 02 21:47:47.611434 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:47.611049    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-z62wt" podUID="163b6f0f-5fc8-4c53-b90a-e748a7fceca6" containerName="authorino" containerID="cri-o://51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f" gracePeriod=30
Jul 02 21:47:47.867200 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:47.866946    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z62wt"
Jul 02 21:47:47.991980 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:47.991945    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th4bq\" (UniqueName: \"kubernetes.io/projected/163b6f0f-5fc8-4c53-b90a-e748a7fceca6-kube-api-access-th4bq\") pod \"163b6f0f-5fc8-4c53-b90a-e748a7fceca6\" (UID: \"163b6f0f-5fc8-4c53-b90a-e748a7fceca6\") "
Jul 02 21:47:47.993993 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:47.993967    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/163b6f0f-5fc8-4c53-b90a-e748a7fceca6-kube-api-access-th4bq" (OuterVolumeSpecName: "kube-api-access-th4bq") pod "163b6f0f-5fc8-4c53-b90a-e748a7fceca6" (UID: "163b6f0f-5fc8-4c53-b90a-e748a7fceca6"). InnerVolumeSpecName "kube-api-access-th4bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:47:48.092695 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.092662    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th4bq\" (UniqueName: \"kubernetes.io/projected/163b6f0f-5fc8-4c53-b90a-e748a7fceca6-kube-api-access-th4bq\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 21:47:48.173385 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.173350    2576 generic.go:356] "Generic (PLEG): container finished" podID="163b6f0f-5fc8-4c53-b90a-e748a7fceca6" containerID="51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f" exitCode=0
Jul 02 21:47:48.173576 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.173394    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z62wt"
Jul 02 21:47:48.173576 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.173434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z62wt" event={"ID":"163b6f0f-5fc8-4c53-b90a-e748a7fceca6","Type":"ContainerDied","Data":"51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f"}
Jul 02 21:47:48.173576 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.173478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z62wt" event={"ID":"163b6f0f-5fc8-4c53-b90a-e748a7fceca6","Type":"ContainerDied","Data":"5fa5f12fa098ae7a84a4453475e83324ebf81681a2a6344e7b858f7ca89e7e1f"}
Jul 02 21:47:48.173576 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.173502    2576 scope.go:117] "RemoveContainer" containerID="51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f"
Jul 02 21:47:48.183078 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.183059    2576 scope.go:117] "RemoveContainer" containerID="51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f"
Jul 02 21:47:48.183408 ip-10-0-131-117 kubenswrapper[2576]: E0702 21:47:48.183388    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f\": container with ID starting with 51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f not found: ID does not exist" containerID="51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f"
Jul 02 21:47:48.183466 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.183418    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f"} err="failed to get container status \"51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f\": rpc error: code = NotFound desc = could not find container \"51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f\": container with ID starting with 51d3aa067f2e0b8450c256fbb76210e83f442b0b87ad022924d4125d3205f81f not found: ID does not exist"
Jul 02 21:47:48.192559 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.192537    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z62wt"]
Jul 02 21:47:48.195816 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:48.195796    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z62wt"]
Jul 02 21:47:49.827031 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:47:49.826999    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="163b6f0f-5fc8-4c53-b90a-e748a7fceca6" path="/var/lib/kubelet/pods/163b6f0f-5fc8-4c53-b90a-e748a7fceca6/volumes"
Jul 02 21:48:27.369090 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:48:27.369052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:48:52.494162 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:48:52.494127    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:49:00.089498 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:00.089467    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:49:13.295822 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:13.295748    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:49:22.191924 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:22.191884    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:49:32.106794 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.106757    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"]
Jul 02 21:49:32.107401 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.107159    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163b6f0f-5fc8-4c53-b90a-e748a7fceca6" containerName="authorino"
Jul 02 21:49:32.107401 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.107175    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="163b6f0f-5fc8-4c53-b90a-e748a7fceca6" containerName="authorino"
Jul 02 21:49:32.107401 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.107270    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="163b6f0f-5fc8-4c53-b90a-e748a7fceca6" containerName="authorino"
Jul 02 21:49:32.110283 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.110263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.112671 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.112650    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 21:49:32.113719 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.113680    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p7grx\""
Jul 02 21:49:32.113719 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.113680    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 21:49:32.113880 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.113722    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 21:49:32.119767 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.119746    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"]
Jul 02 21:49:32.241076 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.241043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmsrf\" (UniqueName: \"kubernetes.io/projected/164ffd66-4f53-4151-8599-a92518840ad3-kube-api-access-nmsrf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.241282 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.241081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.241282 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.241110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.241282 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.241194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.241282 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.241254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/164ffd66-4f53-4151-8599-a92518840ad3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.241464 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.241297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.341763 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.341732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.341875 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.341777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.341928 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.341905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.341984 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.341945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/164ffd66-4f53-4151-8599-a92518840ad3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.342036 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.341989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.342094 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.342048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmsrf\" (UniqueName: \"kubernetes.io/projected/164ffd66-4f53-4151-8599-a92518840ad3-kube-api-access-nmsrf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.342144 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.342114    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.342279 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.342258    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.342373 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.342355    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.344029 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.344012    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/164ffd66-4f53-4151-8599-a92518840ad3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.344320 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.344305    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/164ffd66-4f53-4151-8599-a92518840ad3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.351193 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.351165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmsrf\" (UniqueName: \"kubernetes.io/projected/164ffd66-4f53-4151-8599-a92518840ad3-kube-api-access-nmsrf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckzwc\" (UID: \"164ffd66-4f53-4151-8599-a92518840ad3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.420370 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.420331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:32.544323 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.544250    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"]
Jul 02 21:49:32.546862 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:49:32.546831    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164ffd66_4f53_4151_8599_a92518840ad3.slice/crio-ad39ab7f7123e399a8b67a5fb1b796f405dc73b979e4618e0fc0bf56ce3d1c24 WatchSource:0}: Error finding container ad39ab7f7123e399a8b67a5fb1b796f405dc73b979e4618e0fc0bf56ce3d1c24: Status 404 returned error can't find the container with id ad39ab7f7123e399a8b67a5fb1b796f405dc73b979e4618e0fc0bf56ce3d1c24
Jul 02 21:49:32.548141 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.548126    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:49:32.602636 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:32.602602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc" event={"ID":"164ffd66-4f53-4151-8599-a92518840ad3","Type":"ContainerStarted","Data":"ad39ab7f7123e399a8b67a5fb1b796f405dc73b979e4618e0fc0bf56ce3d1c24"}
Jul 02 21:49:33.608936 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:33.608895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc" event={"ID":"164ffd66-4f53-4151-8599-a92518840ad3","Type":"ContainerStarted","Data":"e8954b81788f1fee93fcab37a77a2276ec9b406c7080d26ad072df6263151fd5"}
Jul 02 21:49:33.634000 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:33.633947    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc" podStartSLOduration=0.648680756 podStartE2EDuration="1.633932041s" totalImagesPullingTime="985.251285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:49:33.633622023 +0000 UTC m=+1104.397153145" watchObservedRunningTime="2026-07-02 21:49:33.633932041 +0000 UTC m=+1104.397463158"
Jul 02 21:49:34.092971 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:34.092931    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:49:41.123330 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.123298    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"]
Jul 02 21:49:41.126380 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.126360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.129046 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.129020    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 21:49:41.144440 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.144418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"]
Jul 02 21:49:41.207242 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.207198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.207388 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.207253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.207388 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.207293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.207388 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.207340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.207388 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.207367    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklgz\" (UniqueName: \"kubernetes.io/projected/70d19fd1-a48b-4fe8-a659-12159d03aa31-kube-api-access-vklgz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.207520 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.207414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d19fd1-a48b-4fe8-a659-12159d03aa31-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.308510 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.308475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d19fd1-a48b-4fe8-a659-12159d03aa31-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.308634 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.308538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.308634 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.308567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.308634 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.308586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.308634 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.308609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.308634 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.308630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklgz\" (UniqueName: \"kubernetes.io/projected/70d19fd1-a48b-4fe8-a659-12159d03aa31-kube-api-access-vklgz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.309077 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.309049    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.309256 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.309081    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.309256 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.309131    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.310870 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.310851    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d19fd1-a48b-4fe8-a659-12159d03aa31-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.311145 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.311126    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d19fd1-a48b-4fe8-a659-12159d03aa31-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.316395 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.316371    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklgz\" (UniqueName: \"kubernetes.io/projected/70d19fd1-a48b-4fe8-a659-12159d03aa31-kube-api-access-vklgz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc\" (UID: \"70d19fd1-a48b-4fe8-a659-12159d03aa31\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.435025 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.434938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:41.560917 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.560892    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"]
Jul 02 21:49:41.563374 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:49:41.563346    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70d19fd1_a48b_4fe8_a659_12159d03aa31.slice/crio-e7b2c095f0433f8d5176984bcabe8922cfca4165d269d508c10a45b9e5893a44 WatchSource:0}: Error finding container e7b2c095f0433f8d5176984bcabe8922cfca4165d269d508c10a45b9e5893a44: Status 404 returned error can't find the container with id e7b2c095f0433f8d5176984bcabe8922cfca4165d269d508c10a45b9e5893a44
Jul 02 21:49:41.645608 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:41.645580    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc" event={"ID":"70d19fd1-a48b-4fe8-a659-12159d03aa31","Type":"ContainerStarted","Data":"e7b2c095f0433f8d5176984bcabe8922cfca4165d269d508c10a45b9e5893a44"}
Jul 02 21:49:42.420747 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:42.420709    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:42.421125 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:42.420781    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:42.433331 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:42.433302    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:42.651105 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:42.651061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc" event={"ID":"70d19fd1-a48b-4fe8-a659-12159d03aa31","Type":"ContainerStarted","Data":"814967f452b12f5d28837d34d4956bc125880b4dda145df1d2c9cd274f734156"}
Jul 02 21:49:42.662803 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:42.662778    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckzwc"
Jul 02 21:49:42.670513 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:42.670473    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc" podStartSLOduration=1.501993638 podStartE2EDuration="1.670459035s" totalImagesPullingTime="168.465397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:49:42.668424706 +0000 UTC m=+1113.431955826" watchObservedRunningTime="2026-07-02 21:49:42.670459035 +0000 UTC m=+1113.433990154"
Jul 02 21:49:43.391621 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:43.391589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:49:51.435921 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:51.435889    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:51.436326 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:51.435936    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:51.448423 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:51.448401    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:49:51.700152 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:49:51.700075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc"
Jul 02 21:50:43.074262 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.074170    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7579555bf9-dmh94"]
Jul 02 21:50:43.077310 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.077292    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.080457 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.080433    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-26fc8\""
Jul 02 21:50:43.080602 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.080477    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 21:50:43.087570 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.087545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7579555bf9-dmh94"]
Jul 02 21:50:43.169807 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.169779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868qj\" (UniqueName: \"kubernetes.io/projected/c3228b4a-255d-455c-9e84-4ba49182a983-kube-api-access-868qj\") pod \"authorino-7579555bf9-dmh94\" (UID: \"c3228b4a-255d-455c-9e84-4ba49182a983\") " pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.169971 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.169821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3228b4a-255d-455c-9e84-4ba49182a983-tls-cert\") pod \"authorino-7579555bf9-dmh94\" (UID: \"c3228b4a-255d-455c-9e84-4ba49182a983\") " pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.271006 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.270974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-868qj\" (UniqueName: \"kubernetes.io/projected/c3228b4a-255d-455c-9e84-4ba49182a983-kube-api-access-868qj\") pod \"authorino-7579555bf9-dmh94\" (UID: \"c3228b4a-255d-455c-9e84-4ba49182a983\") " pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.271161 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.271024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3228b4a-255d-455c-9e84-4ba49182a983-tls-cert\") pod \"authorino-7579555bf9-dmh94\" (UID: \"c3228b4a-255d-455c-9e84-4ba49182a983\") " pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.273590 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.273568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3228b4a-255d-455c-9e84-4ba49182a983-tls-cert\") pod \"authorino-7579555bf9-dmh94\" (UID: \"c3228b4a-255d-455c-9e84-4ba49182a983\") " pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.278312 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.278287    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-868qj\" (UniqueName: \"kubernetes.io/projected/c3228b4a-255d-455c-9e84-4ba49182a983-kube-api-access-868qj\") pod \"authorino-7579555bf9-dmh94\" (UID: \"c3228b4a-255d-455c-9e84-4ba49182a983\") " pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.390150 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.390119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7579555bf9-dmh94"
Jul 02 21:50:43.524692 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.524668    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7579555bf9-dmh94"]
Jul 02 21:50:43.527087 ip-10-0-131-117 kubenswrapper[2576]: W0702 21:50:43.527055    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3228b4a_255d_455c_9e84_4ba49182a983.slice/crio-0a3c3f6bd492a789f1f57659bb5d37f36a5960d150142f50896cd6fa8f461b4e WatchSource:0}: Error finding container 0a3c3f6bd492a789f1f57659bb5d37f36a5960d150142f50896cd6fa8f461b4e: Status 404 returned error can't find the container with id 0a3c3f6bd492a789f1f57659bb5d37f36a5960d150142f50896cd6fa8f461b4e
Jul 02 21:50:43.892142 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:43.892115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7579555bf9-dmh94" event={"ID":"c3228b4a-255d-455c-9e84-4ba49182a983","Type":"ContainerStarted","Data":"0a3c3f6bd492a789f1f57659bb5d37f36a5960d150142f50896cd6fa8f461b4e"}
Jul 02 21:50:44.898104 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:44.898069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7579555bf9-dmh94" event={"ID":"c3228b4a-255d-455c-9e84-4ba49182a983","Type":"ContainerStarted","Data":"f22f64b086dd56b0bd2ca467a607915c14428f4cfe209362a0acde04f4ac247c"}
Jul 02 21:50:44.921012 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:50:44.920953    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7579555bf9-dmh94" podStartSLOduration=1.6075499500000001 podStartE2EDuration="1.920932209s" totalImagesPullingTime="313.382259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:50:44.919533849 +0000 UTC m=+1175.683064970" watchObservedRunningTime="2026-07-02 21:50:44.920932209 +0000 UTC m=+1175.684463334"
Jul 02 21:51:15.796497 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:51:15.796451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:51:26.993007 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:51:26.992974    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:51:35.690698 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:51:35.690664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:51:43.614240 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:51:43.614186    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:51:52.289169 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:51:52.289135    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:52:01.205269 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:52:01.205167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:52:22.986782 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:52:22.986745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:52:35.395066 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:52:35.395031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:53:05.491632 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:53:05.491602    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:53:14.893734 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:53:14.893631    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:53:22.793100 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:53:22.793071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:53:32.888658 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:53:32.888576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:53:42.695271 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:53:42.695242    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:53:51.389810 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:53:51.389766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:54:04.083919 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:54:04.083884    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:54:13.094458 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:54:13.094418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:54:39.299718 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:54:39.299685    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:54:48.293886 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:54:48.293851    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:55:10.994451 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:55:10.994370    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:55:21.195644 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:55:21.195607    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:55:35.501062 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:55:35.501028    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:55:44.688816 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:55:44.688779    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:55:55.599819 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:55:55.599782    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:56:04.390787 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:56:04.390755    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:56:12.895837 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:56:12.895796    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:58:02.284549 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:58:02.284469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:58:12.888475 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:58:12.888437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:58:23.685611 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:58:23.685574    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:58:33.998677 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:58:33.998641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:58:44.489246 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:58:44.489189    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:58:55.891926 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:58:55.891893    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:59:04.488406 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:59:04.488371    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:59:15.188432 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:59:15.188395    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:59:26.393522 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:59:26.393482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:59:33.989549 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:59:33.989470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:59:42.688002 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:59:42.687971    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 21:59:51.997929 ip-10-0-131-117 kubenswrapper[2576]: I0702 21:59:51.997894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:00:09.885759 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:00:09.885725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:00:18.683958 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:00:18.683925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:00:29.790336 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:00:29.790303    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:00:38.787454 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:00:38.787413    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:00:54.597625 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:00:54.597593    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:01:03.393554 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:01:03.393470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:01:12.094350 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:01:12.094311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:01:22.195720 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:01:22.195678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:01:30.794321 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:01:30.794284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:01:39.787707 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:01:39.787664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:01:45.492016 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:01:45.491972    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:01:54.591081 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:01:54.591047    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:02:03.196091 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:02:03.196058    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:02:12.901083 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:02:12.901049    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:02:24.184822 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:02:24.184789    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:02:36.806133 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:02:36.806051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:02:44.705356 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:02:44.705318    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:02:55.903771 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:02:55.903728    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:03:05.702063 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:03:05.702026    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:03:18.330679 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:03:18.330646    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:03:30.390151 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:03:30.390118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:03:45.689180 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:03:45.689144    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:03:55.186567 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:03:55.186529    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:04:06.628530 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:04:06.628486    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:04:22.907470 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:04:22.907436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:04:32.500389 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:04:32.500349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:06:12.790197 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:06:12.790119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:06:21.390615 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:06:21.390579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:06:34.291505 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:06:34.291467    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:06:44.607269 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:06:44.607234    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:07:15.583162 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:15.583067    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:07:32.735100 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.735067    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"]
Jul 02 22:07:32.738068 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.738052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.740444 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.740423    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7bd61c91\"/\"default-dockercfg-cqm7f\""
Jul 02 22:07:32.740631 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.740617    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7bd61c91\"/\"openshift-service-ca.crt\""
Jul 02 22:07:32.741564 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.741542    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7bd61c91\"/\"e2e-lifecycle-model-7bd61c91-kserve-self-signed-certs\""
Jul 02 22:07:32.741681 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.741581    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7bd61c91\"/\"kube-root-ca.crt\""
Jul 02 22:07:32.749148 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.749123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"]
Jul 02 22:07:32.871321 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.871290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-home\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.871490 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.871329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-model-cache\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.871490 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.871357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-dshm\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.871490 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.871431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf8dm\" (UniqueName: \"kubernetes.io/projected/f5ce2cd9-3ef3-428e-8a97-ebc224548708-kube-api-access-tf8dm\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.871490 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.871473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tls-certs\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.871647 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.871498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tmp-dir\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.972522 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tmp-dir\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.972754 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-home\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.972754 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-model-cache\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.972754 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-dshm\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.972925 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf8dm\" (UniqueName: \"kubernetes.io/projected/f5ce2cd9-3ef3-428e-8a97-ebc224548708-kube-api-access-tf8dm\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.972925 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tls-certs\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.972925 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-home\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.973083 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tmp-dir\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.973083 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.972955    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-model-cache\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.974931 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.974911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-dshm\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.975080 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.975063    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tls-certs\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:32.981745 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:32.981721    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf8dm\" (UniqueName: \"kubernetes.io/projected/f5ce2cd9-3ef3-428e-8a97-ebc224548708-kube-api-access-tf8dm\") pod \"e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") " pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:33.047774 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:33.047698    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:33.173564 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:33.173533    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"]
Jul 02 22:07:33.176700 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:07:33.176675    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5ce2cd9_3ef3_428e_8a97_ebc224548708.slice/crio-f3746832c8d300c3055851b9f1df1582834a27d700a9f8cbb95504a3b70fd3a9 WatchSource:0}: Error finding container f3746832c8d300c3055851b9f1df1582834a27d700a9f8cbb95504a3b70fd3a9: Status 404 returned error can't find the container with id f3746832c8d300c3055851b9f1df1582834a27d700a9f8cbb95504a3b70fd3a9
Jul 02 22:07:34.033445 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:34.033411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588" event={"ID":"f5ce2cd9-3ef3-428e-8a97-ebc224548708","Type":"ContainerStarted","Data":"7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f"}
Jul 02 22:07:34.033819 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:34.033458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588" event={"ID":"f5ce2cd9-3ef3-428e-8a97-ebc224548708","Type":"ContainerStarted","Data":"f3746832c8d300c3055851b9f1df1582834a27d700a9f8cbb95504a3b70fd3a9"}
Jul 02 22:07:34.052402 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:34.052354    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588" podStartSLOduration=2.052338218 podStartE2EDuration="2.052338218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:07:34.05147563 +0000 UTC m=+2184.815006750" watchObservedRunningTime="2026-07-02 22:07:34.052338218 +0000 UTC m=+2184.815869349"
Jul 02 22:07:35.497951 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:35.497916    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:07:43.048630 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:43.048591    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:43.049090 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:43.048642    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:43.061191 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:43.061168    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:43.085102 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:43.085079    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:07:48.994608 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:07:48.994576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:08:02.900230 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:02.900179    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:08:02.904634 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:02.904613    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"]
Jul 02 22:08:17.925482 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:17.925443    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588" podUID="f5ce2cd9-3ef3-428e-8a97-ebc224548708" containerName="main" containerID="cri-o://7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f" gracePeriod=45
Jul 02 22:08:18.170039 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.170015    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:08:18.217112 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.217027    2576 generic.go:356] "Generic (PLEG): container finished" podID="f5ce2cd9-3ef3-428e-8a97-ebc224548708" containerID="7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f" exitCode=0
Jul 02 22:08:18.217112 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.217082    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"
Jul 02 22:08:18.217112 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.217089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588" event={"ID":"f5ce2cd9-3ef3-428e-8a97-ebc224548708","Type":"ContainerDied","Data":"7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f"}
Jul 02 22:08:18.217422 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.217121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588" event={"ID":"f5ce2cd9-3ef3-428e-8a97-ebc224548708","Type":"ContainerDied","Data":"f3746832c8d300c3055851b9f1df1582834a27d700a9f8cbb95504a3b70fd3a9"}
Jul 02 22:08:18.217422 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.217139    2576 scope.go:117] "RemoveContainer" containerID="7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f"
Jul 02 22:08:18.225596 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.225574    2576 scope.go:117] "RemoveContainer" containerID="7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f"
Jul 02 22:08:18.225865 ip-10-0-131-117 kubenswrapper[2576]: E0702 22:08:18.225847    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f\": container with ID starting with 7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f not found: ID does not exist" containerID="7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f"
Jul 02 22:08:18.225909 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.225874    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f"} err="failed to get container status \"7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f\": rpc error: code = NotFound desc = could not find container \"7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f\": container with ID starting with 7fec89b820b0f88b15dc511d1755f900cbf84ce8d6e6a4be776d8e61b1b7e14f not found: ID does not exist"
Jul 02 22:08:18.252236 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252190    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-model-cache\") pod \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") "
Jul 02 22:08:18.252354 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252261    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-dshm\") pod \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") "
Jul 02 22:08:18.252354 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252283    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf8dm\" (UniqueName: \"kubernetes.io/projected/f5ce2cd9-3ef3-428e-8a97-ebc224548708-kube-api-access-tf8dm\") pod \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") "
Jul 02 22:08:18.252354 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252304    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tmp-dir\") pod \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") "
Jul 02 22:08:18.252354 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252328    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-home\") pod \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") "
Jul 02 22:08:18.252354 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252350    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tls-certs\") pod \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\" (UID: \"f5ce2cd9-3ef3-428e-8a97-ebc224548708\") "
Jul 02 22:08:18.252620 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252416    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-model-cache" (OuterVolumeSpecName: "model-cache") pod "f5ce2cd9-3ef3-428e-8a97-ebc224548708" (UID: "f5ce2cd9-3ef3-428e-8a97-ebc224548708"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:08:18.252620 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252579    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f5ce2cd9-3ef3-428e-8a97-ebc224548708" (UID: "f5ce2cd9-3ef3-428e-8a97-ebc224548708"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:08:18.252735 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252633    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-home" (OuterVolumeSpecName: "home") pod "f5ce2cd9-3ef3-428e-8a97-ebc224548708" (UID: "f5ce2cd9-3ef3-428e-8a97-ebc224548708"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:08:18.252735 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.252642    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:08:18.254564 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.254540    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ce2cd9-3ef3-428e-8a97-ebc224548708-kube-api-access-tf8dm" (OuterVolumeSpecName: "kube-api-access-tf8dm") pod "f5ce2cd9-3ef3-428e-8a97-ebc224548708" (UID: "f5ce2cd9-3ef3-428e-8a97-ebc224548708"). InnerVolumeSpecName "kube-api-access-tf8dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:08:18.254564 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.254556    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f5ce2cd9-3ef3-428e-8a97-ebc224548708" (UID: "f5ce2cd9-3ef3-428e-8a97-ebc224548708"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:08:18.254705 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.254589    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-dshm" (OuterVolumeSpecName: "dshm") pod "f5ce2cd9-3ef3-428e-8a97-ebc224548708" (UID: "f5ce2cd9-3ef3-428e-8a97-ebc224548708"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:08:18.353920 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.353885    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:08:18.354085 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.353913    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf8dm\" (UniqueName: \"kubernetes.io/projected/f5ce2cd9-3ef3-428e-8a97-ebc224548708-kube-api-access-tf8dm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:08:18.354368 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.354307    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:08:18.354368 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.354333    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5ce2cd9-3ef3-428e-8a97-ebc224548708-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:08:18.354368 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.354347    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5ce2cd9-3ef3-428e-8a97-ebc224548708-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:08:18.538650 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.538618    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"]
Jul 02 22:08:18.542286 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:18.542256    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-7bd61c91/e2e-lifecycle-model-7bd61c91-kserve-6d89f448f9-2b588"]
Jul 02 22:08:19.828172 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:19.828141    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5ce2cd9-3ef3-428e-8a97-ebc224548708" path="/var/lib/kubelet/pods/f5ce2cd9-3ef3-428e-8a97-ebc224548708/volumes"
Jul 02 22:08:42.994896 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:08:42.994864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:09:04.210951 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:09:04.210902    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:09:17.591832 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:09:17.591794    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:10:05.390478 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:05.390401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:10:15.593873 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:15.593841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:10:19.628506 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.628473    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"]
Jul 02 22:10:19.628912 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.628761    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ce2cd9-3ef3-428e-8a97-ebc224548708" containerName="main"
Jul 02 22:10:19.628912 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.628772    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ce2cd9-3ef3-428e-8a97-ebc224548708" containerName="main"
Jul 02 22:10:19.628912 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.628822    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5ce2cd9-3ef3-428e-8a97-ebc224548708" containerName="main"
Jul 02 22:10:19.631558 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.631539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.635250 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.635231    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f4f68d\"/\"openshift-service-ca.crt\""
Jul 02 22:10:19.635387 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.635236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f4f68d\"/\"kube-root-ca.crt\""
Jul 02 22:10:19.635387 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.635256    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f4f68d\"/\"test-model-f4f68d-kserve-self-signed-certs\""
Jul 02 22:10:19.635387 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.635255    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f4f68d\"/\"default-dockercfg-qmklf\""
Jul 02 22:10:19.640419 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.640400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"]
Jul 02 22:10:19.683495 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.683467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b577v\" (UniqueName: \"kubernetes.io/projected/ee7849ba-ae76-48d5-ad1a-252356aa372d-kube-api-access-b577v\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.683604 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.683499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-model-cache\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.683604 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.683536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee7849ba-ae76-48d5-ad1a-252356aa372d-tls-certs\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.683604 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.683556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-dshm\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.683604 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.683581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-home\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.683604 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.683603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-tmp-dir\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.784690 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.784659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-model-cache\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.784892 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.784723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee7849ba-ae76-48d5-ad1a-252356aa372d-tls-certs\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.784892 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.784753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-dshm\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.784892 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.784796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-home\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.784892 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.784827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-tmp-dir\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.784892 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.784862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b577v\" (UniqueName: \"kubernetes.io/projected/ee7849ba-ae76-48d5-ad1a-252356aa372d-kube-api-access-b577v\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.785133 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.785101    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-model-cache\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.785184 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.785134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-home\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.785273 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.785249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-tmp-dir\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.787042 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.787021    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-dshm\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.787189 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.787173    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee7849ba-ae76-48d5-ad1a-252356aa372d-tls-certs\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.793690 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.793669    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b577v\" (UniqueName: \"kubernetes.io/projected/ee7849ba-ae76-48d5-ad1a-252356aa372d-kube-api-access-b577v\") pod \"test-model-f4f68d-kserve-68b8b6457c-w6rlk\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") " pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:19.940885 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:19.940800    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:20.066587 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:20.066564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"]
Jul 02 22:10:20.069058 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:10:20.069022    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee7849ba_ae76_48d5_ad1a_252356aa372d.slice/crio-568ba8c97fa36fd46de088c327575d8175f319fa418368b86bcef578605cf691 WatchSource:0}: Error finding container 568ba8c97fa36fd46de088c327575d8175f319fa418368b86bcef578605cf691: Status 404 returned error can't find the container with id 568ba8c97fa36fd46de088c327575d8175f319fa418368b86bcef578605cf691
Jul 02 22:10:20.716522 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:20.716486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk" event={"ID":"ee7849ba-ae76-48d5-ad1a-252356aa372d","Type":"ContainerStarted","Data":"99e142d60eab40c53c3469af56c1889cd1d615c99c66c9c8eed5090727d52b61"}
Jul 02 22:10:20.716919 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:20.716533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk" event={"ID":"ee7849ba-ae76-48d5-ad1a-252356aa372d","Type":"ContainerStarted","Data":"568ba8c97fa36fd46de088c327575d8175f319fa418368b86bcef578605cf691"}
Jul 02 22:10:20.736778 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:20.736727    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk" podStartSLOduration=1.736710556 podStartE2EDuration="1.736710556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:10:20.736292907 +0000 UTC m=+2351.499824029" watchObservedRunningTime="2026-07-02 22:10:20.736710556 +0000 UTC m=+2351.500241676"
Jul 02 22:10:23.907097 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:23.907061    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:10:29.941192 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:29.941155    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:29.941585 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:29.941224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:29.953603 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:29.953575    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:30.766799 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:30.766769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:10:51.328385 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.328353    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"]
Jul 02 22:10:51.331792 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.331769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.334307 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.334282    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-37c632\"/\"openshift-service-ca.crt\""
Jul 02 22:10:51.334435 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.334422    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-37c632\"/\"kube-root-ca.crt\""
Jul 02 22:10:51.335334 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.335316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-37c632\"/\"test-model-37c632-kserve-self-signed-certs\""
Jul 02 22:10:51.335431 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.335333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-37c632\"/\"default-dockercfg-x4p4v\""
Jul 02 22:10:51.341671 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.341648    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"]
Jul 02 22:10:51.447809 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.447780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c607269c-ed72-43c9-af29-5e72caf25c25-tls-certs\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.447983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.447829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-home\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.447983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.447847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s79f\" (UniqueName: \"kubernetes.io/projected/c607269c-ed72-43c9-af29-5e72caf25c25-kube-api-access-6s79f\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.447983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.447913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-model-cache\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.447983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.447945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-tmp-dir\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.447983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.447978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-dshm\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.548999 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.548963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-home\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.548999 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s79f\" (UniqueName: \"kubernetes.io/projected/c607269c-ed72-43c9-af29-5e72caf25c25-kube-api-access-6s79f\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.549256 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-model-cache\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.549256 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-tmp-dir\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.549256 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-dshm\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.549428 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c607269c-ed72-43c9-af29-5e72caf25c25-tls-certs\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.549497 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549480    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-tmp-dir\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.549550 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549529    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-home\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.549593 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.549555    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-model-cache\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.551361 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.551343    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-dshm\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.551615 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.551597    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c607269c-ed72-43c9-af29-5e72caf25c25-tls-certs\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.558324 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.558301    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s79f\" (UniqueName: \"kubernetes.io/projected/c607269c-ed72-43c9-af29-5e72caf25c25-kube-api-access-6s79f\") pod \"test-model-37c632-kserve-7b958b46b5-8z8gh\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") " pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.642176 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.642154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:10:51.768892 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.768865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"]
Jul 02 22:10:51.770997 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:10:51.770964    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc607269c_ed72_43c9_af29_5e72caf25c25.slice/crio-12c9680c268a298423a9cff6dfaea46ea4a2b9324a9f49d073ff9441ef4f52f5 WatchSource:0}: Error finding container 12c9680c268a298423a9cff6dfaea46ea4a2b9324a9f49d073ff9441ef4f52f5: Status 404 returned error can't find the container with id 12c9680c268a298423a9cff6dfaea46ea4a2b9324a9f49d073ff9441ef4f52f5
Jul 02 22:10:51.840290 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.840259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh" event={"ID":"c607269c-ed72-43c9-af29-5e72caf25c25","Type":"ContainerStarted","Data":"2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d"}
Jul 02 22:10:51.840404 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.840300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh" event={"ID":"c607269c-ed72-43c9-af29-5e72caf25c25","Type":"ContainerStarted","Data":"12c9680c268a298423a9cff6dfaea46ea4a2b9324a9f49d073ff9441ef4f52f5"}
Jul 02 22:10:51.857464 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:51.857421    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh" podStartSLOduration=0.857403247 podStartE2EDuration="857.403247ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:10:51.856714136 +0000 UTC m=+2382.620245257" watchObservedRunningTime="2026-07-02 22:10:51.857403247 +0000 UTC m=+2382.620934367"
Jul 02 22:10:56.295856 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:10:56.295818    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:11:01.642731 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:01.642701    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:11:01.643111 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:01.642764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:11:01.654880 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:01.654851    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:11:01.893862 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:01.893786    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:11:13.774632 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:13.774599    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"]
Jul 02 22:11:14.702945 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:14.702913    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"]
Jul 02 22:11:19.092949 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:19.092916    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:11:28.795189 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:28.795130    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk" podUID="ee7849ba-ae76-48d5-ad1a-252356aa372d" containerName="main" containerID="cri-o://99e142d60eab40c53c3469af56c1889cd1d615c99c66c9c8eed5090727d52b61" gracePeriod=45
Jul 02 22:11:28.996822 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:28.996788    2576 generic.go:356] "Generic (PLEG): container finished" podID="ee7849ba-ae76-48d5-ad1a-252356aa372d" containerID="99e142d60eab40c53c3469af56c1889cd1d615c99c66c9c8eed5090727d52b61" exitCode=0
Jul 02 22:11:28.996967 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:28.996863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk" event={"ID":"ee7849ba-ae76-48d5-ad1a-252356aa372d","Type":"ContainerDied","Data":"99e142d60eab40c53c3469af56c1889cd1d615c99c66c9c8eed5090727d52b61"}
Jul 02 22:11:29.044403 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.044380    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:11:29.143791 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.143761    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b577v\" (UniqueName: \"kubernetes.io/projected/ee7849ba-ae76-48d5-ad1a-252356aa372d-kube-api-access-b577v\") pod \"ee7849ba-ae76-48d5-ad1a-252356aa372d\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") "
Jul 02 22:11:29.143979 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.143802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee7849ba-ae76-48d5-ad1a-252356aa372d-tls-certs\") pod \"ee7849ba-ae76-48d5-ad1a-252356aa372d\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") "
Jul 02 22:11:29.143979 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.143838    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-model-cache\") pod \"ee7849ba-ae76-48d5-ad1a-252356aa372d\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") "
Jul 02 22:11:29.143979 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.143852    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-home\") pod \"ee7849ba-ae76-48d5-ad1a-252356aa372d\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") "
Jul 02 22:11:29.143979 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.143880    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-dshm\") pod \"ee7849ba-ae76-48d5-ad1a-252356aa372d\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") "
Jul 02 22:11:29.143979 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.143909    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-tmp-dir\") pod \"ee7849ba-ae76-48d5-ad1a-252356aa372d\" (UID: \"ee7849ba-ae76-48d5-ad1a-252356aa372d\") "
Jul 02 22:11:29.144259 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.144058    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee7849ba-ae76-48d5-ad1a-252356aa372d" (UID: "ee7849ba-ae76-48d5-ad1a-252356aa372d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:29.144259 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.144122    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-home" (OuterVolumeSpecName: "home") pod "ee7849ba-ae76-48d5-ad1a-252356aa372d" (UID: "ee7849ba-ae76-48d5-ad1a-252356aa372d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:29.144344 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.144251    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee7849ba-ae76-48d5-ad1a-252356aa372d" (UID: "ee7849ba-ae76-48d5-ad1a-252356aa372d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:29.146140 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.146105    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-dshm" (OuterVolumeSpecName: "dshm") pod "ee7849ba-ae76-48d5-ad1a-252356aa372d" (UID: "ee7849ba-ae76-48d5-ad1a-252356aa372d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:29.146260 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.146162    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee7849ba-ae76-48d5-ad1a-252356aa372d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee7849ba-ae76-48d5-ad1a-252356aa372d" (UID: "ee7849ba-ae76-48d5-ad1a-252356aa372d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:11:29.146260 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.146194    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee7849ba-ae76-48d5-ad1a-252356aa372d-kube-api-access-b577v" (OuterVolumeSpecName: "kube-api-access-b577v") pod "ee7849ba-ae76-48d5-ad1a-252356aa372d" (UID: "ee7849ba-ae76-48d5-ad1a-252356aa372d"). InnerVolumeSpecName "kube-api-access-b577v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:11:29.244931 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.244892    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:29.244931 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.244923    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:29.244931 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.244934    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b577v\" (UniqueName: \"kubernetes.io/projected/ee7849ba-ae76-48d5-ad1a-252356aa372d-kube-api-access-b577v\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:29.244931 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.244942    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee7849ba-ae76-48d5-ad1a-252356aa372d-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:29.245187 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.244951    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:29.245187 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.244959    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee7849ba-ae76-48d5-ad1a-252356aa372d-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:29.723383 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.723348    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh" podUID="c607269c-ed72-43c9-af29-5e72caf25c25" containerName="main" containerID="cri-o://2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d" gracePeriod=45
Jul 02 22:11:29.966754 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:29.966729    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:11:30.003168 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.003091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"
Jul 02 22:11:30.003168 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.003117    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk" event={"ID":"ee7849ba-ae76-48d5-ad1a-252356aa372d","Type":"ContainerDied","Data":"568ba8c97fa36fd46de088c327575d8175f319fa418368b86bcef578605cf691"}
Jul 02 22:11:30.003168 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.003165    2576 scope.go:117] "RemoveContainer" containerID="99e142d60eab40c53c3469af56c1889cd1d615c99c66c9c8eed5090727d52b61"
Jul 02 22:11:30.004701 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.004677    2576 generic.go:356] "Generic (PLEG): container finished" podID="c607269c-ed72-43c9-af29-5e72caf25c25" containerID="2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d" exitCode=0
Jul 02 22:11:30.004805 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.004725    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"
Jul 02 22:11:30.004805 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.004747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh" event={"ID":"c607269c-ed72-43c9-af29-5e72caf25c25","Type":"ContainerDied","Data":"2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d"}
Jul 02 22:11:30.004805 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.004771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh" event={"ID":"c607269c-ed72-43c9-af29-5e72caf25c25","Type":"ContainerDied","Data":"12c9680c268a298423a9cff6dfaea46ea4a2b9324a9f49d073ff9441ef4f52f5"}
Jul 02 22:11:30.012952 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.012932    2576 scope.go:117] "RemoveContainer" containerID="2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d"
Jul 02 22:11:30.020158 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.020143    2576 scope.go:117] "RemoveContainer" containerID="2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d"
Jul 02 22:11:30.020425 ip-10-0-131-117 kubenswrapper[2576]: E0702 22:11:30.020408    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d\": container with ID starting with 2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d not found: ID does not exist" containerID="2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d"
Jul 02 22:11:30.020490 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.020434    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d"} err="failed to get container status \"2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d\": rpc error: code = NotFound desc = could not find container \"2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d\": container with ID starting with 2f3ec55026e1be183e570cc302fe7545e2b8786c98d9fb8c7cf197652f47ac8d not found: ID does not exist"
Jul 02 22:11:30.023536 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.023510    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"]
Jul 02 22:11:30.025200 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.025181    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-f4f68d/test-model-f4f68d-kserve-68b8b6457c-w6rlk"]
Jul 02 22:11:30.052988 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.052966    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-dshm\") pod \"c607269c-ed72-43c9-af29-5e72caf25c25\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") "
Jul 02 22:11:30.053136 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053015    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-tmp-dir\") pod \"c607269c-ed72-43c9-af29-5e72caf25c25\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") "
Jul 02 22:11:30.053136 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053043    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-model-cache\") pod \"c607269c-ed72-43c9-af29-5e72caf25c25\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") "
Jul 02 22:11:30.053136 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053074    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-home\") pod \"c607269c-ed72-43c9-af29-5e72caf25c25\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") "
Jul 02 22:11:30.053136 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053094    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c607269c-ed72-43c9-af29-5e72caf25c25-tls-certs\") pod \"c607269c-ed72-43c9-af29-5e72caf25c25\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") "
Jul 02 22:11:30.053136 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053128    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s79f\" (UniqueName: \"kubernetes.io/projected/c607269c-ed72-43c9-af29-5e72caf25c25-kube-api-access-6s79f\") pod \"c607269c-ed72-43c9-af29-5e72caf25c25\" (UID: \"c607269c-ed72-43c9-af29-5e72caf25c25\") "
Jul 02 22:11:30.053417 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053350    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-model-cache" (OuterVolumeSpecName: "model-cache") pod "c607269c-ed72-43c9-af29-5e72caf25c25" (UID: "c607269c-ed72-43c9-af29-5e72caf25c25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:30.053417 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053366    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-home" (OuterVolumeSpecName: "home") pod "c607269c-ed72-43c9-af29-5e72caf25c25" (UID: "c607269c-ed72-43c9-af29-5e72caf25c25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:30.053417 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.053396    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c607269c-ed72-43c9-af29-5e72caf25c25" (UID: "c607269c-ed72-43c9-af29-5e72caf25c25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:30.055262 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.055183    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-dshm" (OuterVolumeSpecName: "dshm") pod "c607269c-ed72-43c9-af29-5e72caf25c25" (UID: "c607269c-ed72-43c9-af29-5e72caf25c25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:11:30.055352 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.055261    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c607269c-ed72-43c9-af29-5e72caf25c25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c607269c-ed72-43c9-af29-5e72caf25c25" (UID: "c607269c-ed72-43c9-af29-5e72caf25c25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:11:30.055352 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.055323    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c607269c-ed72-43c9-af29-5e72caf25c25-kube-api-access-6s79f" (OuterVolumeSpecName: "kube-api-access-6s79f") pod "c607269c-ed72-43c9-af29-5e72caf25c25" (UID: "c607269c-ed72-43c9-af29-5e72caf25c25"). InnerVolumeSpecName "kube-api-access-6s79f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:11:30.153720 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.153690    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:30.153720 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.153716    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c607269c-ed72-43c9-af29-5e72caf25c25-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:30.153720 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.153727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s79f\" (UniqueName: \"kubernetes.io/projected/c607269c-ed72-43c9-af29-5e72caf25c25-kube-api-access-6s79f\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:30.153946 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.153735    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:30.153946 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.153743    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:30.153946 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.153751    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c607269c-ed72-43c9-af29-5e72caf25c25-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:11:30.325056 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.325026    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"]
Jul 02 22:11:30.328756 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:30.328734    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-37c632/test-model-37c632-kserve-7b958b46b5-8z8gh"]
Jul 02 22:11:31.827708 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:31.827612    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c607269c-ed72-43c9-af29-5e72caf25c25" path="/var/lib/kubelet/pods/c607269c-ed72-43c9-af29-5e72caf25c25/volumes"
Jul 02 22:11:31.828230 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:11:31.828183    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee7849ba-ae76-48d5-ad1a-252356aa372d" path="/var/lib/kubelet/pods/ee7849ba-ae76-48d5-ad1a-252356aa372d/volumes"
Jul 02 22:12:01.294961 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:12:01.294924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:12:14.290374 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:12:14.290343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:12:26.208114 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:12:26.208075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:12:36.387174 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:12:36.387136    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:12:45.195560 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:12:45.195525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:12:55.210436 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:12:55.210402    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:13:05.212649 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:05.212565    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:13:12.631550 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.631512    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"]
Jul 02 22:13:12.631901 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.631781    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee7849ba-ae76-48d5-ad1a-252356aa372d" containerName="main"
Jul 02 22:13:12.631901 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.631792    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee7849ba-ae76-48d5-ad1a-252356aa372d" containerName="main"
Jul 02 22:13:12.631901 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.631800    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c607269c-ed72-43c9-af29-5e72caf25c25" containerName="main"
Jul 02 22:13:12.631901 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.631806    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c607269c-ed72-43c9-af29-5e72caf25c25" containerName="main"
Jul 02 22:13:12.631901 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.631864    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee7849ba-ae76-48d5-ad1a-252356aa372d" containerName="main"
Jul 02 22:13:12.631901 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.631873    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c607269c-ed72-43c9-af29-5e72caf25c25" containerName="main"
Jul 02 22:13:12.634583 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.634563    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.637122 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.637102    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"openshift-service-ca.crt\""
Jul 02 22:13:12.638178 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.638159    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"kube-root-ca.crt\""
Jul 02 22:13:12.638300 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.638281    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"default-dockercfg-cckvc\""
Jul 02 22:13:12.638369 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.638315    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"auth-test-model-77374e-kserve-self-signed-certs\""
Jul 02 22:13:12.644825 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.644805    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"]
Jul 02 22:13:12.682302 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.682272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-dshm\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.682422 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.682319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-home\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.682422 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.682345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-tmp-dir\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.682422 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.682383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-model-cache\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.682422 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.682400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705c5dca-62e9-4800-9541-4ecea3db5f71-tls-certs\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.682422 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.682417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndh2\" (UniqueName: \"kubernetes.io/projected/705c5dca-62e9-4800-9541-4ecea3db5f71-kube-api-access-bndh2\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783190 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-model-cache\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783190 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705c5dca-62e9-4800-9541-4ecea3db5f71-tls-certs\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783415 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bndh2\" (UniqueName: \"kubernetes.io/projected/705c5dca-62e9-4800-9541-4ecea3db5f71-kube-api-access-bndh2\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783415 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-dshm\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783415 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-home\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783415 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-tmp-dir\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783642 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-model-cache\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783700 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783681    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-tmp-dir\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.783743 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.783708    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-home\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.785613 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.785594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-dshm\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.785982 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.785962    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705c5dca-62e9-4800-9541-4ecea3db5f71-tls-certs\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.791832 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.791809    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndh2\" (UniqueName: \"kubernetes.io/projected/705c5dca-62e9-4800-9541-4ecea3db5f71-kube-api-access-bndh2\") pod \"auth-test-model-77374e-kserve-5464f69b7f-xb68d\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") " pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:12.944020 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:12.943931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:13.072709 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:13.072678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"]
Jul 02 22:13:13.076420 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:13:13.076387    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod705c5dca_62e9_4800_9541_4ecea3db5f71.slice/crio-2f9f0fb4e9eec7bfa44c994f6d685fe267d404abc682196c8cca8af6498bad59 WatchSource:0}: Error finding container 2f9f0fb4e9eec7bfa44c994f6d685fe267d404abc682196c8cca8af6498bad59: Status 404 returned error can't find the container with id 2f9f0fb4e9eec7bfa44c994f6d685fe267d404abc682196c8cca8af6498bad59
Jul 02 22:13:13.435488 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:13.435446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d" event={"ID":"705c5dca-62e9-4800-9541-4ecea3db5f71","Type":"ContainerStarted","Data":"6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388"}
Jul 02 22:13:13.435488 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:13.435493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d" event={"ID":"705c5dca-62e9-4800-9541-4ecea3db5f71","Type":"ContainerStarted","Data":"2f9f0fb4e9eec7bfa44c994f6d685fe267d404abc682196c8cca8af6498bad59"}
Jul 02 22:13:13.452832 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:13.452785    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d" podStartSLOduration=1.452770367 podStartE2EDuration="1.452770367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:13:13.451806424 +0000 UTC m=+2524.215337549" watchObservedRunningTime="2026-07-02 22:13:13.452770367 +0000 UTC m=+2524.216301487"
Jul 02 22:13:15.685313 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:15.685284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:13:22.945139 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:22.945096    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:22.945623 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:22.945189    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:22.957746 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:22.957722    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:23.488595 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:23.488567    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:13:37.154864 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.154834    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"]
Jul 02 22:13:37.157730 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.157714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.162436 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.162414    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"kube-root-ca.crt\""
Jul 02 22:13:37.162560 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.162414    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"openshift-service-ca.crt\""
Jul 02 22:13:37.163303 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.163283    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"auth-test-model-a51408-kserve-self-signed-certs\""
Jul 02 22:13:37.163412 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.163283    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"default-dockercfg-jvsp7\""
Jul 02 22:13:37.174007 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.173986    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"]
Jul 02 22:13:37.278478 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.278441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-home\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.278478 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.278476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-model-cache\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.278679 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.278559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-dshm\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.278679 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.278599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-tmp-dir\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.278679 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.278619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspjv\" (UniqueName: \"kubernetes.io/projected/55e16820-7163-45a3-8152-7a8fa284cd98-kube-api-access-hspjv\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.278679 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.278658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e16820-7163-45a3-8152-7a8fa284cd98-tls-certs\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379186 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-dshm\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379309 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-tmp-dir\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379309 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hspjv\" (UniqueName: \"kubernetes.io/projected/55e16820-7163-45a3-8152-7a8fa284cd98-kube-api-access-hspjv\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379309 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e16820-7163-45a3-8152-7a8fa284cd98-tls-certs\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379440 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-home\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379440 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-model-cache\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379698 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379674    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-tmp-dir\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379782 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379697    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-model-cache\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.379782 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.379734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-home\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.381444 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.381417    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-dshm\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.381823 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.381798    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e16820-7163-45a3-8152-7a8fa284cd98-tls-certs\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.389772 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.389748    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspjv\" (UniqueName: \"kubernetes.io/projected/55e16820-7163-45a3-8152-7a8fa284cd98-kube-api-access-hspjv\") pod \"auth-test-model-a51408-kserve-5bb9866b99-d8xxg\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") " pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.466777 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.466694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:37.595739 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:37.595716    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"]
Jul 02 22:13:37.598395 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:13:37.598373    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e16820_7163_45a3_8152_7a8fa284cd98.slice/crio-85b288ee786a8db49a705a0507a7fbdc6c692f22a33dcbe496ce079288e603c5 WatchSource:0}: Error finding container 85b288ee786a8db49a705a0507a7fbdc6c692f22a33dcbe496ce079288e603c5: Status 404 returned error can't find the container with id 85b288ee786a8db49a705a0507a7fbdc6c692f22a33dcbe496ce079288e603c5
Jul 02 22:13:38.540967 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:38.540934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg" event={"ID":"55e16820-7163-45a3-8152-7a8fa284cd98","Type":"ContainerStarted","Data":"5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12"}
Jul 02 22:13:38.540967 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:38.540972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg" event={"ID":"55e16820-7163-45a3-8152-7a8fa284cd98","Type":"ContainerStarted","Data":"85b288ee786a8db49a705a0507a7fbdc6c692f22a33dcbe496ce079288e603c5"}
Jul 02 22:13:38.557757 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:38.557706    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg" podStartSLOduration=1.557690955 podStartE2EDuration="1.557690955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:13:38.557155266 +0000 UTC m=+2549.320686413" watchObservedRunningTime="2026-07-02 22:13:38.557690955 +0000 UTC m=+2549.321222129"
Jul 02 22:13:40.899342 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:40.899311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:13:47.467611 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:47.467574    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:47.468007 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:47.467625    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:47.479774 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:47.479751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:13:47.587860 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:13:47.587833    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:14:05.494410 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:14:05.494377    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:14:20.103056 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:14:20.103022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:14:37.289415 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:14:37.289384    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:14:53.501072 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:14:53.501040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:15:09.891016 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:09.890976    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:15:22.896883 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:22.896851    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:15:35.309598 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:35.309562    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"]
Jul 02 22:15:36.130375 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:36.130340    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"]
Jul 02 22:15:39.293631 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:39.293588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:15:40.270444 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.270408    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"]
Jul 02 22:15:40.273864 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.273843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.277230 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.277196    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"sub-test-model-77374e-kserve-self-signed-certs\""
Jul 02 22:15:40.290516 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.290496    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"]
Jul 02 22:15:40.304342 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.304319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-home\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.304642 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.304345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-dshm\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.304642 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.304363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdb660e-e123-43d1-9e97-777c52186a7a-tls-certs\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.304642 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.304427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-tmp-dir\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.304642 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.304473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-model-cache\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.304642 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.304508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzkzp\" (UniqueName: \"kubernetes.io/projected/5cdb660e-e123-43d1-9e97-777c52186a7a-kube-api-access-dzkzp\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405174 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-model-cache\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405364 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkzp\" (UniqueName: \"kubernetes.io/projected/5cdb660e-e123-43d1-9e97-777c52186a7a-kube-api-access-dzkzp\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405364 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-home\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405364 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-dshm\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405364 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdb660e-e123-43d1-9e97-777c52186a7a-tls-certs\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405566 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-tmp-dir\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405622 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405598    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-model-cache\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405658 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-home\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.405766 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.405750    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-tmp-dir\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.407433 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.407409    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-dshm\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.407570 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.407555    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdb660e-e123-43d1-9e97-777c52186a7a-tls-certs\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.413756 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.413736    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzkzp\" (UniqueName: \"kubernetes.io/projected/5cdb660e-e123-43d1-9e97-777c52186a7a-kube-api-access-dzkzp\") pod \"sub-test-model-77374e-kserve-b48588cbf-g26gp\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") " pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.582401 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.582317    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:40.707860 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:40.707837    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"]
Jul 02 22:15:41.052414 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:41.052378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp" event={"ID":"5cdb660e-e123-43d1-9e97-777c52186a7a","Type":"ContainerStarted","Data":"f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95"}
Jul 02 22:15:41.052584 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:41.052425    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp" event={"ID":"5cdb660e-e123-43d1-9e97-777c52186a7a","Type":"ContainerStarted","Data":"8fd0997cf634718a4c366a1f04a444b3b09add235f10e614cef54c60a32466fb"}
Jul 02 22:15:41.071100 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:41.071059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp" podStartSLOduration=1.071043208 podStartE2EDuration="1.071043208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:15:41.069270936 +0000 UTC m=+2671.832802038" watchObservedRunningTime="2026-07-02 22:15:41.071043208 +0000 UTC m=+2671.834574328"
Jul 02 22:15:50.329604 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.329566    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d" podUID="705c5dca-62e9-4800-9541-4ecea3db5f71" containerName="main" containerID="cri-o://6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388" gracePeriod=45
Jul 02 22:15:50.572324 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.572300    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:15:50.582538 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.582491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:50.582538 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.582529    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:50.595685 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.595660    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:50.691939 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.691908    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bndh2\" (UniqueName: \"kubernetes.io/projected/705c5dca-62e9-4800-9541-4ecea3db5f71-kube-api-access-bndh2\") pod \"705c5dca-62e9-4800-9541-4ecea3db5f71\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") "
Jul 02 22:15:50.692103 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.691960    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-home\") pod \"705c5dca-62e9-4800-9541-4ecea3db5f71\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") "
Jul 02 22:15:50.692103 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.692040    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705c5dca-62e9-4800-9541-4ecea3db5f71-tls-certs\") pod \"705c5dca-62e9-4800-9541-4ecea3db5f71\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") "
Jul 02 22:15:50.692103 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.692067    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-tmp-dir\") pod \"705c5dca-62e9-4800-9541-4ecea3db5f71\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") "
Jul 02 22:15:50.692103 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.692091    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-model-cache\") pod \"705c5dca-62e9-4800-9541-4ecea3db5f71\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") "
Jul 02 22:15:50.692391 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.692127    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-dshm\") pod \"705c5dca-62e9-4800-9541-4ecea3db5f71\" (UID: \"705c5dca-62e9-4800-9541-4ecea3db5f71\") "
Jul 02 22:15:50.692391 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.692372    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-home" (OuterVolumeSpecName: "home") pod "705c5dca-62e9-4800-9541-4ecea3db5f71" (UID: "705c5dca-62e9-4800-9541-4ecea3db5f71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:50.692558 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.692485    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-model-cache" (OuterVolumeSpecName: "model-cache") pod "705c5dca-62e9-4800-9541-4ecea3db5f71" (UID: "705c5dca-62e9-4800-9541-4ecea3db5f71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:50.692558 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.692496    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "705c5dca-62e9-4800-9541-4ecea3db5f71" (UID: "705c5dca-62e9-4800-9541-4ecea3db5f71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:50.694292 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.694263    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-dshm" (OuterVolumeSpecName: "dshm") pod "705c5dca-62e9-4800-9541-4ecea3db5f71" (UID: "705c5dca-62e9-4800-9541-4ecea3db5f71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:50.694401 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.694297    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705c5dca-62e9-4800-9541-4ecea3db5f71-kube-api-access-bndh2" (OuterVolumeSpecName: "kube-api-access-bndh2") pod "705c5dca-62e9-4800-9541-4ecea3db5f71" (UID: "705c5dca-62e9-4800-9541-4ecea3db5f71"). InnerVolumeSpecName "kube-api-access-bndh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:15:50.694401 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.694338    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705c5dca-62e9-4800-9541-4ecea3db5f71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "705c5dca-62e9-4800-9541-4ecea3db5f71" (UID: "705c5dca-62e9-4800-9541-4ecea3db5f71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:15:50.793049 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.793010    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705c5dca-62e9-4800-9541-4ecea3db5f71-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:50.793049 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.793039    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:50.793049 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.793051    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:50.793370 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.793064    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:50.793370 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.793074    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bndh2\" (UniqueName: \"kubernetes.io/projected/705c5dca-62e9-4800-9541-4ecea3db5f71-kube-api-access-bndh2\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:50.793370 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:50.793086    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705c5dca-62e9-4800-9541-4ecea3db5f71-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:51.093927 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.093894    2576 generic.go:356] "Generic (PLEG): container finished" podID="705c5dca-62e9-4800-9541-4ecea3db5f71" containerID="6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388" exitCode=0
Jul 02 22:15:51.094092 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.093946    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"
Jul 02 22:15:51.094092 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.093980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d" event={"ID":"705c5dca-62e9-4800-9541-4ecea3db5f71","Type":"ContainerDied","Data":"6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388"}
Jul 02 22:15:51.094092 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.094022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d" event={"ID":"705c5dca-62e9-4800-9541-4ecea3db5f71","Type":"ContainerDied","Data":"2f9f0fb4e9eec7bfa44c994f6d685fe267d404abc682196c8cca8af6498bad59"}
Jul 02 22:15:51.094092 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.094038    2576 scope.go:117] "RemoveContainer" containerID="6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388"
Jul 02 22:15:51.102989 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.102974    2576 scope.go:117] "RemoveContainer" containerID="6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388"
Jul 02 22:15:51.103319 ip-10-0-131-117 kubenswrapper[2576]: E0702 22:15:51.103301    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388\": container with ID starting with 6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388 not found: ID does not exist" containerID="6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388"
Jul 02 22:15:51.103382 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.103326    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388"} err="failed to get container status \"6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388\": rpc error: code = NotFound desc = could not find container \"6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388\": container with ID starting with 6caf6f4f368554eb3e79d3819785fe8fa769a975f8045ec27e1752c846983388 not found: ID does not exist"
Jul 02 22:15:51.106092 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.106074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:15:51.116200 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.116182    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"]
Jul 02 22:15:51.120828 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.120808    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/auth-test-model-77374e-kserve-5464f69b7f-xb68d"]
Jul 02 22:15:51.150570 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.150536    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg" podUID="55e16820-7163-45a3-8152-7a8fa284cd98" containerName="main" containerID="cri-o://5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12" gracePeriod=45
Jul 02 22:15:51.406796 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.406770    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:15:51.498261 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498231    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-tmp-dir\") pod \"55e16820-7163-45a3-8152-7a8fa284cd98\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") "
Jul 02 22:15:51.498411 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498279    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-model-cache\") pod \"55e16820-7163-45a3-8152-7a8fa284cd98\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") "
Jul 02 22:15:51.498411 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498312    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-home\") pod \"55e16820-7163-45a3-8152-7a8fa284cd98\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") "
Jul 02 22:15:51.498411 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498334    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-dshm\") pod \"55e16820-7163-45a3-8152-7a8fa284cd98\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") "
Jul 02 22:15:51.498411 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498354    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e16820-7163-45a3-8152-7a8fa284cd98-tls-certs\") pod \"55e16820-7163-45a3-8152-7a8fa284cd98\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") "
Jul 02 22:15:51.498411 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498393    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hspjv\" (UniqueName: \"kubernetes.io/projected/55e16820-7163-45a3-8152-7a8fa284cd98-kube-api-access-hspjv\") pod \"55e16820-7163-45a3-8152-7a8fa284cd98\" (UID: \"55e16820-7163-45a3-8152-7a8fa284cd98\") "
Jul 02 22:15:51.498654 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498413    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "55e16820-7163-45a3-8152-7a8fa284cd98" (UID: "55e16820-7163-45a3-8152-7a8fa284cd98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:51.498654 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498522    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-model-cache" (OuterVolumeSpecName: "model-cache") pod "55e16820-7163-45a3-8152-7a8fa284cd98" (UID: "55e16820-7163-45a3-8152-7a8fa284cd98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:51.498654 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498588    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-home" (OuterVolumeSpecName: "home") pod "55e16820-7163-45a3-8152-7a8fa284cd98" (UID: "55e16820-7163-45a3-8152-7a8fa284cd98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:51.498654 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498641    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:51.498654 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498653    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:51.498865 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.498685    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:51.500583 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.500554    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-dshm" (OuterVolumeSpecName: "dshm") pod "55e16820-7163-45a3-8152-7a8fa284cd98" (UID: "55e16820-7163-45a3-8152-7a8fa284cd98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:51.500583 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.500569    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55e16820-7163-45a3-8152-7a8fa284cd98-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "55e16820-7163-45a3-8152-7a8fa284cd98" (UID: "55e16820-7163-45a3-8152-7a8fa284cd98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:15:51.500728 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.500621    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55e16820-7163-45a3-8152-7a8fa284cd98-kube-api-access-hspjv" (OuterVolumeSpecName: "kube-api-access-hspjv") pod "55e16820-7163-45a3-8152-7a8fa284cd98" (UID: "55e16820-7163-45a3-8152-7a8fa284cd98"). InnerVolumeSpecName "kube-api-access-hspjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:15:51.599994 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.599961    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e16820-7163-45a3-8152-7a8fa284cd98-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:51.599994 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.599988    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e16820-7163-45a3-8152-7a8fa284cd98-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:51.599994 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.600000    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hspjv\" (UniqueName: \"kubernetes.io/projected/55e16820-7163-45a3-8152-7a8fa284cd98-kube-api-access-hspjv\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:15:51.827414 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:51.827334    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="705c5dca-62e9-4800-9541-4ecea3db5f71" path="/var/lib/kubelet/pods/705c5dca-62e9-4800-9541-4ecea3db5f71/volumes"
Jul 02 22:15:52.099420 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.099330    2576 generic.go:356] "Generic (PLEG): container finished" podID="55e16820-7163-45a3-8152-7a8fa284cd98" containerID="5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12" exitCode=0
Jul 02 22:15:52.099420 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.099375    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"
Jul 02 22:15:52.099420 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.099412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg" event={"ID":"55e16820-7163-45a3-8152-7a8fa284cd98","Type":"ContainerDied","Data":"5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12"}
Jul 02 22:15:52.099697 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.099451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg" event={"ID":"55e16820-7163-45a3-8152-7a8fa284cd98","Type":"ContainerDied","Data":"85b288ee786a8db49a705a0507a7fbdc6c692f22a33dcbe496ce079288e603c5"}
Jul 02 22:15:52.099697 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.099470    2576 scope.go:117] "RemoveContainer" containerID="5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12"
Jul 02 22:15:52.107563 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.107545    2576 scope.go:117] "RemoveContainer" containerID="5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12"
Jul 02 22:15:52.107833 ip-10-0-131-117 kubenswrapper[2576]: E0702 22:15:52.107815    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12\": container with ID starting with 5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12 not found: ID does not exist" containerID="5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12"
Jul 02 22:15:52.107876 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.107842    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12"} err="failed to get container status \"5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12\": rpc error: code = NotFound desc = could not find container \"5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12\": container with ID starting with 5b9168cd56860da0f07e0b09210ff1c2abf774e2d18afd032f97e4fdec1f8e12 not found: ID does not exist"
Jul 02 22:15:52.114113 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.114092    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"]
Jul 02 22:15:52.120121 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:52.120100    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/auth-test-model-a51408-kserve-5bb9866b99-d8xxg"]
Jul 02 22:15:53.690778 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:53.690745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:15:53.826984 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:15:53.826952    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55e16820-7163-45a3-8152-7a8fa284cd98" path="/var/lib/kubelet/pods/55e16820-7163-45a3-8152-7a8fa284cd98/volumes"
Jul 02 22:16:14.528354 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.528318    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"]
Jul 02 22:16:14.528903 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.528708    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705c5dca-62e9-4800-9541-4ecea3db5f71" containerName="main"
Jul 02 22:16:14.528903 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.528724    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="705c5dca-62e9-4800-9541-4ecea3db5f71" containerName="main"
Jul 02 22:16:14.528903 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.528752    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e16820-7163-45a3-8152-7a8fa284cd98" containerName="main"
Jul 02 22:16:14.528903 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.528761    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e16820-7163-45a3-8152-7a8fa284cd98" containerName="main"
Jul 02 22:16:14.528903 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.528844    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="705c5dca-62e9-4800-9541-4ecea3db5f71" containerName="main"
Jul 02 22:16:14.528903 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.528859    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="55e16820-7163-45a3-8152-7a8fa284cd98" containerName="main"
Jul 02 22:16:14.533463 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.533443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.536785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.536758    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"kube-root-ca.crt\""
Jul 02 22:16:14.536785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.536765    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"default-dockercfg-jvsp7\""
Jul 02 22:16:14.536955 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.536806    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"sub-test-model-a51408-kserve-self-signed-certs\""
Jul 02 22:16:14.536955 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.536813    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"openshift-service-ca.crt\""
Jul 02 22:16:14.539670 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.539638    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"]
Jul 02 22:16:14.684643 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.684606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-home\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.684809 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.684656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-model-cache\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.684809 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.684687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tmp-dir\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.684809 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.684714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-dshm\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.684809 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.684750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxqp\" (UniqueName: \"kubernetes.io/projected/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-kube-api-access-ksxqp\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.684953 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.684806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tls-certs\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786063 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.785991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-home\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786063 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-model-cache\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786063 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tmp-dir\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786344 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-dshm\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786344 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxqp\" (UniqueName: \"kubernetes.io/projected/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-kube-api-access-ksxqp\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786344 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tls-certs\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786504 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786448    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-model-cache\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786504 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786475    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-home\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.786596 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.786519    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tmp-dir\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.788450 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.788419    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-dshm\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.788556 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.788537    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tls-certs\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.794015 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.793999    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxqp\" (UniqueName: \"kubernetes.io/projected/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-kube-api-access-ksxqp\") pod \"sub-test-model-a51408-kserve-7ff4cd56d5-tcs26\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") " pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.843415 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.843393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:14.968456 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:14.968422    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"]
Jul 02 22:16:14.972613 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:16:14.972581    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60f1cfa4_09ca_4488_a97f_39e5f7b7bf4d.slice/crio-25b5e3ab361ab5c5caccdea37eef5a5547b1eeb45dcbe5e821b867a1172ed2b6 WatchSource:0}: Error finding container 25b5e3ab361ab5c5caccdea37eef5a5547b1eeb45dcbe5e821b867a1172ed2b6: Status 404 returned error can't find the container with id 25b5e3ab361ab5c5caccdea37eef5a5547b1eeb45dcbe5e821b867a1172ed2b6
Jul 02 22:16:15.197950 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:15.197911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26" event={"ID":"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d","Type":"ContainerStarted","Data":"3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307"}
Jul 02 22:16:15.198133 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:15.197959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26" event={"ID":"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d","Type":"ContainerStarted","Data":"25b5e3ab361ab5c5caccdea37eef5a5547b1eeb45dcbe5e821b867a1172ed2b6"}
Jul 02 22:16:15.214831 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:15.214785    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26" podStartSLOduration=1.214769972 podStartE2EDuration="1.214769972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:16:15.214032752 +0000 UTC m=+2705.977563872" watchObservedRunningTime="2026-07-02 22:16:15.214769972 +0000 UTC m=+2705.978301093"
Jul 02 22:16:18.991564 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:18.991529    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:16:24.843823 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:24.843787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:24.844331 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:24.843840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:24.856362 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:24.856340    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:25.250919 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:25.250891    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:16:36.597938 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:36.597892    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:16:50.994647 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:50.994611    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:16:58.074336 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:58.074305    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"]
Jul 02 22:16:58.932072 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:16:58.932042    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"]
Jul 02 22:17:07.691881 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:07.691843    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:17:13.093997 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.093933    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp" podUID="5cdb660e-e123-43d1-9e97-777c52186a7a" containerName="main" containerID="cri-o://f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95" gracePeriod=45
Jul 02 22:17:13.345673 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.345615    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:17:13.444218 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.444184    2576 generic.go:356] "Generic (PLEG): container finished" podID="5cdb660e-e123-43d1-9e97-777c52186a7a" containerID="f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95" exitCode=0
Jul 02 22:17:13.444370 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.444235    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"
Jul 02 22:17:13.444370 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.444270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp" event={"ID":"5cdb660e-e123-43d1-9e97-777c52186a7a","Type":"ContainerDied","Data":"f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95"}
Jul 02 22:17:13.444370 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.444310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp" event={"ID":"5cdb660e-e123-43d1-9e97-777c52186a7a","Type":"ContainerDied","Data":"8fd0997cf634718a4c366a1f04a444b3b09add235f10e614cef54c60a32466fb"}
Jul 02 22:17:13.444370 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.444327    2576 scope.go:117] "RemoveContainer" containerID="f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95"
Jul 02 22:17:13.452093 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.452076    2576 scope.go:117] "RemoveContainer" containerID="f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95"
Jul 02 22:17:13.452375 ip-10-0-131-117 kubenswrapper[2576]: E0702 22:17:13.452355    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95\": container with ID starting with f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95 not found: ID does not exist" containerID="f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95"
Jul 02 22:17:13.452426 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.452383    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95"} err="failed to get container status \"f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95\": rpc error: code = NotFound desc = could not find container \"f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95\": container with ID starting with f1d778afd5d8bf5e9d5d9cb8400293fd1a84791bead25df752b359cd7fc4df95 not found: ID does not exist"
Jul 02 22:17:13.472630 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.472607    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzkzp\" (UniqueName: \"kubernetes.io/projected/5cdb660e-e123-43d1-9e97-777c52186a7a-kube-api-access-dzkzp\") pod \"5cdb660e-e123-43d1-9e97-777c52186a7a\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") "
Jul 02 22:17:13.472726 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.472644    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-model-cache\") pod \"5cdb660e-e123-43d1-9e97-777c52186a7a\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") "
Jul 02 22:17:13.472726 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.472668    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-dshm\") pod \"5cdb660e-e123-43d1-9e97-777c52186a7a\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") "
Jul 02 22:17:13.472726 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.472701    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-tmp-dir\") pod \"5cdb660e-e123-43d1-9e97-777c52186a7a\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") "
Jul 02 22:17:13.472726 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.472724    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdb660e-e123-43d1-9e97-777c52186a7a-tls-certs\") pod \"5cdb660e-e123-43d1-9e97-777c52186a7a\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") "
Jul 02 22:17:13.472885 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.472764    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-home\") pod \"5cdb660e-e123-43d1-9e97-777c52186a7a\" (UID: \"5cdb660e-e123-43d1-9e97-777c52186a7a\") "
Jul 02 22:17:13.474231 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.473198    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5cdb660e-e123-43d1-9e97-777c52186a7a" (UID: "5cdb660e-e123-43d1-9e97-777c52186a7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:13.474231 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.473234    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5cdb660e-e123-43d1-9e97-777c52186a7a" (UID: "5cdb660e-e123-43d1-9e97-777c52186a7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:13.474231 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.473378    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-home" (OuterVolumeSpecName: "home") pod "5cdb660e-e123-43d1-9e97-777c52186a7a" (UID: "5cdb660e-e123-43d1-9e97-777c52186a7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:13.475547 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.475494    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdb660e-e123-43d1-9e97-777c52186a7a-kube-api-access-dzkzp" (OuterVolumeSpecName: "kube-api-access-dzkzp") pod "5cdb660e-e123-43d1-9e97-777c52186a7a" (UID: "5cdb660e-e123-43d1-9e97-777c52186a7a"). InnerVolumeSpecName "kube-api-access-dzkzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:17:13.475647 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.475555    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdb660e-e123-43d1-9e97-777c52186a7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5cdb660e-e123-43d1-9e97-777c52186a7a" (UID: "5cdb660e-e123-43d1-9e97-777c52186a7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:17:13.478257 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.475798    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:13.478257 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.475820    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzkzp\" (UniqueName: \"kubernetes.io/projected/5cdb660e-e123-43d1-9e97-777c52186a7a-kube-api-access-dzkzp\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:13.478257 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.475836    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:13.478257 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.475876    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:13.478257 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.475890    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdb660e-e123-43d1-9e97-777c52186a7a-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:13.479935 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.479911    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-dshm" (OuterVolumeSpecName: "dshm") pod "5cdb660e-e123-43d1-9e97-777c52186a7a" (UID: "5cdb660e-e123-43d1-9e97-777c52186a7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:13.576457 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.576430    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdb660e-e123-43d1-9e97-777c52186a7a-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:13.766558 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.766518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"]
Jul 02 22:17:13.768617 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.768595    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/sub-test-model-77374e-kserve-b48588cbf-g26gp"]
Jul 02 22:17:13.827220 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.827188    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cdb660e-e123-43d1-9e97-777c52186a7a" path="/var/lib/kubelet/pods/5cdb660e-e123-43d1-9e97-777c52186a7a/volumes"
Jul 02 22:17:13.952801 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:13.952761    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26" podUID="60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" containerName="main" containerID="cri-o://3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307" gracePeriod=45
Jul 02 22:17:14.189538 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.189512    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:17:14.382834 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.382804    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-home\") pod \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") "
Jul 02 22:17:14.383026 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.382838    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-dshm\") pod \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") "
Jul 02 22:17:14.383026 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.382877    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tls-certs\") pod \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") "
Jul 02 22:17:14.383026 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.382900    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tmp-dir\") pod \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") "
Jul 02 22:17:14.383026 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.382947    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksxqp\" (UniqueName: \"kubernetes.io/projected/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-kube-api-access-ksxqp\") pod \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") "
Jul 02 22:17:14.383026 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.383000    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-model-cache\") pod \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\" (UID: \"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d\") "
Jul 02 22:17:14.383274 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.383047    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-home" (OuterVolumeSpecName: "home") pod "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" (UID: "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:14.383274 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.383169    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" (UID: "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:14.383274 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.383184    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-model-cache" (OuterVolumeSpecName: "model-cache") pod "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" (UID: "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:14.383410 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.383279    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:14.383410 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.383293    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:14.383410 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.383305    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:14.384928 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.384907    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-dshm" (OuterVolumeSpecName: "dshm") pod "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" (UID: "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:17:14.385020 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.384999    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" (UID: "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:17:14.385143 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.385127    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-kube-api-access-ksxqp" (OuterVolumeSpecName: "kube-api-access-ksxqp") pod "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" (UID: "60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d"). InnerVolumeSpecName "kube-api-access-ksxqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:17:14.450827 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.450798    2576 generic.go:356] "Generic (PLEG): container finished" podID="60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" containerID="3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307" exitCode=0
Jul 02 22:17:14.450955 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.450838    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"
Jul 02 22:17:14.450955 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.450890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26" event={"ID":"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d","Type":"ContainerDied","Data":"3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307"}
Jul 02 22:17:14.450955 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.450926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26" event={"ID":"60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d","Type":"ContainerDied","Data":"25b5e3ab361ab5c5caccdea37eef5a5547b1eeb45dcbe5e821b867a1172ed2b6"}
Jul 02 22:17:14.450955 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.450944    2576 scope.go:117] "RemoveContainer" containerID="3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307"
Jul 02 22:17:14.459493 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.459476    2576 scope.go:117] "RemoveContainer" containerID="3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307"
Jul 02 22:17:14.459736 ip-10-0-131-117 kubenswrapper[2576]: E0702 22:17:14.459716    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307\": container with ID starting with 3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307 not found: ID does not exist" containerID="3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307"
Jul 02 22:17:14.459796 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.459747    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307"} err="failed to get container status \"3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307\": rpc error: code = NotFound desc = could not find container \"3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307\": container with ID starting with 3c41e104a18c0dcda0534f50f32c13ef4a684cbf52ba86be40859073eaeb2307 not found: ID does not exist"
Jul 02 22:17:14.471324 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.471303    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"]
Jul 02 22:17:14.474896 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.474879    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/sub-test-model-a51408-kserve-7ff4cd56d5-tcs26"]
Jul 02 22:17:14.483727 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.483711    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:14.483793 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.483729    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:14.483793 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:14.483738    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksxqp\" (UniqueName: \"kubernetes.io/projected/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d-kube-api-access-ksxqp\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:17:15.827134 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:15.827099    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" path="/var/lib/kubelet/pods/60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d/volumes"
Jul 02 22:17:28.525124 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.525082    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"]
Jul 02 22:17:28.525785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.525384    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdb660e-e123-43d1-9e97-777c52186a7a" containerName="main"
Jul 02 22:17:28.525785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.525396    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdb660e-e123-43d1-9e97-777c52186a7a" containerName="main"
Jul 02 22:17:28.525785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.525418    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" containerName="main"
Jul 02 22:17:28.525785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.525423    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" containerName="main"
Jul 02 22:17:28.525785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.525472    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cdb660e-e123-43d1-9e97-777c52186a7a" containerName="main"
Jul 02 22:17:28.525785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.525478    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="60f1cfa4-09ca-4488-a97f-39e5f7b7bf4d" containerName="main"
Jul 02 22:17:28.534552 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.534532    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.537859 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.537822    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"default-dockercfg-cckvc\""
Jul 02 22:17:28.538037 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.537860    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"kube-root-ca.crt\""
Jul 02 22:17:28.538196 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.538178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"rate-test-model-77374e-kserve-self-signed-certs\""
Jul 02 22:17:28.538335 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.538309    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77374e\"/\"openshift-service-ca.crt\""
Jul 02 22:17:28.539764 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.539740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"]
Jul 02 22:17:28.585899 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.585870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-home\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.585899 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.585902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed41180-4929-4179-91c7-b3d7ed236a6b-tls-certs\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.586068 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.585972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-model-cache\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.586068 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.586002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp4zg\" (UniqueName: \"kubernetes.io/projected/eed41180-4929-4179-91c7-b3d7ed236a6b-kube-api-access-sp4zg\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.586068 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.586037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-dshm\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.586068 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.586054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-tmp-dir\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.686643 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.686607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-model-cache\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.686643 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.686640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp4zg\" (UniqueName: \"kubernetes.io/projected/eed41180-4929-4179-91c7-b3d7ed236a6b-kube-api-access-sp4zg\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.686872 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.686663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-dshm\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.686872 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.686678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-tmp-dir\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.686872 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.686709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-home\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.686872 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.686725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed41180-4929-4179-91c7-b3d7ed236a6b-tls-certs\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.687118 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.687090    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-tmp-dir\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.687194 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.687097    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-model-cache\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.687194 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.687164    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-home\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.688971 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.688955    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-dshm\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.689267 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.689245    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed41180-4929-4179-91c7-b3d7ed236a6b-tls-certs\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.694851 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.694826    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp4zg\" (UniqueName: \"kubernetes.io/projected/eed41180-4929-4179-91c7-b3d7ed236a6b-kube-api-access-sp4zg\") pod \"rate-test-model-77374e-kserve-f556cff75-s92gk\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") " pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.844526 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.844430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:28.974280 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:28.974252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"]
Jul 02 22:17:28.976290 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:17:28.976256    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeed41180_4929_4179_91c7_b3d7ed236a6b.slice/crio-19ef5279a61a0d7c29d987cf1ad492f2c0e5a772076d1ae7ee2a460ae1588600 WatchSource:0}: Error finding container 19ef5279a61a0d7c29d987cf1ad492f2c0e5a772076d1ae7ee2a460ae1588600: Status 404 returned error can't find the container with id 19ef5279a61a0d7c29d987cf1ad492f2c0e5a772076d1ae7ee2a460ae1588600
Jul 02 22:17:29.516039 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:29.516004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk" event={"ID":"eed41180-4929-4179-91c7-b3d7ed236a6b","Type":"ContainerStarted","Data":"a20aa320991fff63d57d170596385a113cc4f185b3ec98656a768f27280bbe61"}
Jul 02 22:17:29.516248 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:29.516047    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk" event={"ID":"eed41180-4929-4179-91c7-b3d7ed236a6b","Type":"ContainerStarted","Data":"19ef5279a61a0d7c29d987cf1ad492f2c0e5a772076d1ae7ee2a460ae1588600"}
Jul 02 22:17:29.533427 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:29.533383    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk" podStartSLOduration=1.533366979 podStartE2EDuration="1.533366979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:17:29.532260253 +0000 UTC m=+2780.295791376" watchObservedRunningTime="2026-07-02 22:17:29.533366979 +0000 UTC m=+2780.296898099"
Jul 02 22:17:31.912909 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:31.912832    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:17:38.845154 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:38.845114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:38.845154 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:38.845160    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:38.857339 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:38.857313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:39.572643 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:39.572617    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:17:54.632503 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.632468    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"]
Jul 02 22:17:54.635766 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.635749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.638103 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.638080    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"openshift-service-ca.crt\""
Jul 02 22:17:54.638993 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.638965    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"default-dockercfg-jvsp7\""
Jul 02 22:17:54.639102 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.638995    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"kube-root-ca.crt\""
Jul 02 22:17:54.639102 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.639033    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a51408\"/\"rate-test-model-a51408-kserve-self-signed-certs\""
Jul 02 22:17:54.644797 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.644777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"]
Jul 02 22:17:54.689390 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.689358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-model-cache\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.689390 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.689393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-home\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.689554 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.689419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/964098c6-26dc-4a23-837b-b8506fbe19d2-tls-certs\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.689554 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.689447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-dshm\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.689554 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.689462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-tmp-dir\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.689554 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.689485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmd4n\" (UniqueName: \"kubernetes.io/projected/964098c6-26dc-4a23-837b-b8506fbe19d2-kube-api-access-tmd4n\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790306 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-model-cache\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790434 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-home\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790434 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/964098c6-26dc-4a23-837b-b8506fbe19d2-tls-certs\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790434 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-dshm\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790434 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-tmp-dir\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790434 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmd4n\" (UniqueName: \"kubernetes.io/projected/964098c6-26dc-4a23-837b-b8506fbe19d2-kube-api-access-tmd4n\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790695 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790677    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-model-cache\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790785 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790723    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-home\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.790854 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.790829    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-tmp-dir\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.792553 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.792536    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-dshm\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.792902 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.792883    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/964098c6-26dc-4a23-837b-b8506fbe19d2-tls-certs\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.798706 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.798680    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmd4n\" (UniqueName: \"kubernetes.io/projected/964098c6-26dc-4a23-837b-b8506fbe19d2-kube-api-access-tmd4n\") pod \"rate-test-model-a51408-kserve-5d87f65f4c-vkb72\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") " pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:54.946173 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:54.946097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:17:55.070804 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:55.070725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"]
Jul 02 22:17:55.073101 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:17:55.073074    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod964098c6_26dc_4a23_837b_b8506fbe19d2.slice/crio-b15a8e67da91f1d6d0893df843de615d362df3ed005bbd87aebba5c825fffa3d WatchSource:0}: Error finding container b15a8e67da91f1d6d0893df843de615d362df3ed005bbd87aebba5c825fffa3d: Status 404 returned error can't find the container with id b15a8e67da91f1d6d0893df843de615d362df3ed005bbd87aebba5c825fffa3d
Jul 02 22:17:55.629398 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:55.629364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72" event={"ID":"964098c6-26dc-4a23-837b-b8506fbe19d2","Type":"ContainerStarted","Data":"4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a"}
Jul 02 22:17:55.629398 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:55.629403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72" event={"ID":"964098c6-26dc-4a23-837b-b8506fbe19d2","Type":"ContainerStarted","Data":"b15a8e67da91f1d6d0893df843de615d362df3ed005bbd87aebba5c825fffa3d"}
Jul 02 22:17:55.645938 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:55.645894    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72" podStartSLOduration=1.6458801250000001 podStartE2EDuration="1.645880125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:17:55.644663829 +0000 UTC m=+2806.408194951" watchObservedRunningTime="2026-07-02 22:17:55.645880125 +0000 UTC m=+2806.409411245"
Jul 02 22:17:58.798848 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:17:58.798811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:18:04.946665 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:04.946630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:18:04.946665 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:04.946674    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:18:04.959079 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:04.959053    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:18:05.680490 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:05.680462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:18:11.488691 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:11.488656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:18:25.990069 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:25.990038    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:18:33.598228 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:33.598179    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"]
Jul 02 22:18:34.448512 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:34.448477    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"]
Jul 02 22:18:39.887594 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:39.887563    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:18:48.618257 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.618198    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk" podUID="eed41180-4929-4179-91c7-b3d7ed236a6b" containerName="main" containerID="cri-o://a20aa320991fff63d57d170596385a113cc4f185b3ec98656a768f27280bbe61" gracePeriod=45
Jul 02 22:18:48.845972 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.845945    2576 generic.go:356] "Generic (PLEG): container finished" podID="eed41180-4929-4179-91c7-b3d7ed236a6b" containerID="a20aa320991fff63d57d170596385a113cc4f185b3ec98656a768f27280bbe61" exitCode=0
Jul 02 22:18:48.846078 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.845981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk" event={"ID":"eed41180-4929-4179-91c7-b3d7ed236a6b","Type":"ContainerDied","Data":"a20aa320991fff63d57d170596385a113cc4f185b3ec98656a768f27280bbe61"}
Jul 02 22:18:48.863794 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.863772    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:18:48.955797 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.955771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-tmp-dir\") pod \"eed41180-4929-4179-91c7-b3d7ed236a6b\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") "
Jul 02 22:18:48.955954 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.955825    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-home\") pod \"eed41180-4929-4179-91c7-b3d7ed236a6b\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") "
Jul 02 22:18:48.955954 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.955844    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp4zg\" (UniqueName: \"kubernetes.io/projected/eed41180-4929-4179-91c7-b3d7ed236a6b-kube-api-access-sp4zg\") pod \"eed41180-4929-4179-91c7-b3d7ed236a6b\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") "
Jul 02 22:18:48.955954 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.955876    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-dshm\") pod \"eed41180-4929-4179-91c7-b3d7ed236a6b\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") "
Jul 02 22:18:48.955954 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.955908    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed41180-4929-4179-91c7-b3d7ed236a6b-tls-certs\") pod \"eed41180-4929-4179-91c7-b3d7ed236a6b\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") "
Jul 02 22:18:48.955954 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.955931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-model-cache\") pod \"eed41180-4929-4179-91c7-b3d7ed236a6b\" (UID: \"eed41180-4929-4179-91c7-b3d7ed236a6b\") "
Jul 02 22:18:48.956193 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.956087    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eed41180-4929-4179-91c7-b3d7ed236a6b" (UID: "eed41180-4929-4179-91c7-b3d7ed236a6b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:48.956193 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.956103    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-home" (OuterVolumeSpecName: "home") pod "eed41180-4929-4179-91c7-b3d7ed236a6b" (UID: "eed41180-4929-4179-91c7-b3d7ed236a6b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:48.956336 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.956304    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-model-cache" (OuterVolumeSpecName: "model-cache") pod "eed41180-4929-4179-91c7-b3d7ed236a6b" (UID: "eed41180-4929-4179-91c7-b3d7ed236a6b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:48.958110 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.958090    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-dshm" (OuterVolumeSpecName: "dshm") pod "eed41180-4929-4179-91c7-b3d7ed236a6b" (UID: "eed41180-4929-4179-91c7-b3d7ed236a6b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:48.958110 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.958099    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed41180-4929-4179-91c7-b3d7ed236a6b-kube-api-access-sp4zg" (OuterVolumeSpecName: "kube-api-access-sp4zg") pod "eed41180-4929-4179-91c7-b3d7ed236a6b" (UID: "eed41180-4929-4179-91c7-b3d7ed236a6b"). InnerVolumeSpecName "kube-api-access-sp4zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:18:48.958273 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:48.958124    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed41180-4929-4179-91c7-b3d7ed236a6b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eed41180-4929-4179-91c7-b3d7ed236a6b" (UID: "eed41180-4929-4179-91c7-b3d7ed236a6b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:18:49.056713 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.056684    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.056713 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.056710    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.056713 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.056719    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.056902 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.056727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp4zg\" (UniqueName: \"kubernetes.io/projected/eed41180-4929-4179-91c7-b3d7ed236a6b-kube-api-access-sp4zg\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.056902 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.056736    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eed41180-4929-4179-91c7-b3d7ed236a6b-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.056902 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.056744    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed41180-4929-4179-91c7-b3d7ed236a6b-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.468059 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.468010    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72" podUID="964098c6-26dc-4a23-837b-b8506fbe19d2" containerName="main" containerID="cri-o://4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a" gracePeriod=45
Jul 02 22:18:49.709263 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.709240    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:18:49.761983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.761910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-home\") pod \"964098c6-26dc-4a23-837b-b8506fbe19d2\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") "
Jul 02 22:18:49.761983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.761948    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmd4n\" (UniqueName: \"kubernetes.io/projected/964098c6-26dc-4a23-837b-b8506fbe19d2-kube-api-access-tmd4n\") pod \"964098c6-26dc-4a23-837b-b8506fbe19d2\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") "
Jul 02 22:18:49.761983 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.761966    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/964098c6-26dc-4a23-837b-b8506fbe19d2-tls-certs\") pod \"964098c6-26dc-4a23-837b-b8506fbe19d2\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") "
Jul 02 22:18:49.762283 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.762004    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-model-cache\") pod \"964098c6-26dc-4a23-837b-b8506fbe19d2\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") "
Jul 02 22:18:49.762283 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.762033    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-dshm\") pod \"964098c6-26dc-4a23-837b-b8506fbe19d2\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") "
Jul 02 22:18:49.762283 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.762059    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-tmp-dir\") pod \"964098c6-26dc-4a23-837b-b8506fbe19d2\" (UID: \"964098c6-26dc-4a23-837b-b8506fbe19d2\") "
Jul 02 22:18:49.762283 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.762173    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-home" (OuterVolumeSpecName: "home") pod "964098c6-26dc-4a23-837b-b8506fbe19d2" (UID: "964098c6-26dc-4a23-837b-b8506fbe19d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:49.762283 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.762255    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.762476 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.762308    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "964098c6-26dc-4a23-837b-b8506fbe19d2" (UID: "964098c6-26dc-4a23-837b-b8506fbe19d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:49.762476 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.762388    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "964098c6-26dc-4a23-837b-b8506fbe19d2" (UID: "964098c6-26dc-4a23-837b-b8506fbe19d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:49.764035 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.764010    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-dshm" (OuterVolumeSpecName: "dshm") pod "964098c6-26dc-4a23-837b-b8506fbe19d2" (UID: "964098c6-26dc-4a23-837b-b8506fbe19d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:18:49.764149 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.764076    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964098c6-26dc-4a23-837b-b8506fbe19d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "964098c6-26dc-4a23-837b-b8506fbe19d2" (UID: "964098c6-26dc-4a23-837b-b8506fbe19d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:18:49.764149 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.764118    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964098c6-26dc-4a23-837b-b8506fbe19d2-kube-api-access-tmd4n" (OuterVolumeSpecName: "kube-api-access-tmd4n") pod "964098c6-26dc-4a23-837b-b8506fbe19d2" (UID: "964098c6-26dc-4a23-837b-b8506fbe19d2"). InnerVolumeSpecName "kube-api-access-tmd4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:18:49.851573 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.851552    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"
Jul 02 22:18:49.851689 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.851578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk" event={"ID":"eed41180-4929-4179-91c7-b3d7ed236a6b","Type":"ContainerDied","Data":"19ef5279a61a0d7c29d987cf1ad492f2c0e5a772076d1ae7ee2a460ae1588600"}
Jul 02 22:18:49.851689 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.851630    2576 scope.go:117] "RemoveContainer" containerID="a20aa320991fff63d57d170596385a113cc4f185b3ec98656a768f27280bbe61"
Jul 02 22:18:49.852866 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.852838    2576 generic.go:356] "Generic (PLEG): container finished" podID="964098c6-26dc-4a23-837b-b8506fbe19d2" containerID="4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a" exitCode=0
Jul 02 22:18:49.852985 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.852877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72" event={"ID":"964098c6-26dc-4a23-837b-b8506fbe19d2","Type":"ContainerDied","Data":"4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a"}
Jul 02 22:18:49.852985 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.852885    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"
Jul 02 22:18:49.852985 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.852903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72" event={"ID":"964098c6-26dc-4a23-837b-b8506fbe19d2","Type":"ContainerDied","Data":"b15a8e67da91f1d6d0893df843de615d362df3ed005bbd87aebba5c825fffa3d"}
Jul 02 22:18:49.859773 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.859757    2576 scope.go:117] "RemoveContainer" containerID="4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a"
Jul 02 22:18:49.863057 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.863032    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmd4n\" (UniqueName: \"kubernetes.io/projected/964098c6-26dc-4a23-837b-b8506fbe19d2-kube-api-access-tmd4n\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.863057 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.863054    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/964098c6-26dc-4a23-837b-b8506fbe19d2-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.863177 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.863068    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.863177 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.863080    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.863177 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.863090    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964098c6-26dc-4a23-837b-b8506fbe19d2-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 02 22:18:49.866663 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.866648    2576 scope.go:117] "RemoveContainer" containerID="4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a"
Jul 02 22:18:49.866886 ip-10-0-131-117 kubenswrapper[2576]: E0702 22:18:49.866869    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a\": container with ID starting with 4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a not found: ID does not exist" containerID="4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a"
Jul 02 22:18:49.866940 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.866899    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a"} err="failed to get container status \"4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a\": rpc error: code = NotFound desc = could not find container \"4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a\": container with ID starting with 4ab6410fe1528cf54a7ebc41949134aa0657e87d9deacd51747cc21df3c7a51a not found: ID does not exist"
Jul 02 22:18:49.869596 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.869576    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"]
Jul 02 22:18:49.873002 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.872984    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-77374e/rate-test-model-77374e-kserve-f556cff75-s92gk"]
Jul 02 22:18:49.882444 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.882417    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"]
Jul 02 22:18:49.890223 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:49.886402    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a51408/rate-test-model-a51408-kserve-5d87f65f4c-vkb72"]
Jul 02 22:18:51.828338 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:51.828306    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="964098c6-26dc-4a23-837b-b8506fbe19d2" path="/var/lib/kubelet/pods/964098c6-26dc-4a23-837b-b8506fbe19d2/volumes"
Jul 02 22:18:51.828694 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:18:51.828665    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed41180-4929-4179-91c7-b3d7ed236a6b" path="/var/lib/kubelet/pods/eed41180-4929-4179-91c7-b3d7ed236a6b/volumes"
Jul 02 22:19:21.687850 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:21.687816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znrmg"]
Jul 02 22:19:25.669644 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:25.669610    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7579555bf9-dmh94_c3228b4a-255d-455c-9e84-4ba49182a983/authorino/0.log"
Jul 02 22:19:31.139536 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:31.139509    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-6m8ms_7ab74886-b86d-44b0-9f99-e181584e667a/copy-manifests/0.log"
Jul 02 22:19:31.147273 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:31.147246    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-6m8ms_7ab74886-b86d-44b0-9f99-e181584e667a/manager/0.log"
Jul 02 22:19:32.768695 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:32.768660    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7579555bf9-dmh94_c3228b4a-255d-455c-9e84-4ba49182a983/authorino/0.log"
Jul 02 22:19:33.476877 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:33.476845    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-znrmg_92857d9f-2fa5-4cb3-9d02-0cc84028e9c0/limitador/0.log"
Jul 02 22:19:34.195486 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:34.195457    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45cbf66b-2cclq_5d977dd7-c20c-4217-9a84-4da38e9b211e/kube-auth-proxy/0.log"
Jul 02 22:19:35.592067 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:35.592036    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ckzwc_164ffd66-4f53-4151-8599-a92518840ad3/main/0.log"
Jul 02 22:19:35.706940 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:35.706910    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ftzsc_70d19fd1-a48b-4fe8-a659-12159d03aa31/main/0.log"
Jul 02 22:19:42.885803 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:42.885749    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cghb6_cb9b5ee3-6870-45f9-9998-33e9ce83e284/global-pull-secret-syncer/0.log"
Jul 02 22:19:43.102713 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:43.102682    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5zr5v_2c8e3666-51cb-4bf8-a213-70955f980526/konnectivity-agent/0.log"
Jul 02 22:19:43.123300 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:43.123266    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-117.ec2.internal_0caf382ca9eb296da259b7ea66c7880a/haproxy/0.log"
Jul 02 22:19:47.901789 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:47.901754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7579555bf9-dmh94_c3228b4a-255d-455c-9e84-4ba49182a983/authorino/0.log"
Jul 02 22:19:48.297904 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:48.297821    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-znrmg_92857d9f-2fa5-4cb3-9d02-0cc84028e9c0/limitador/0.log"
Jul 02 22:19:50.245611 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:50.245576    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lv9nt_c86d2faf-3311-4101-bac1-ae780ade8382/monitoring-plugin/0.log"
Jul 02 22:19:50.370156 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:50.370120    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m4dv_d5057cd3-f9c4-4629-80b9-04dab4afb90b/node-exporter/0.log"
Jul 02 22:19:50.397332 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:50.397303    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m4dv_d5057cd3-f9c4-4629-80b9-04dab4afb90b/kube-rbac-proxy/0.log"
Jul 02 22:19:50.428559 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:50.428536    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m4dv_d5057cd3-f9c4-4629-80b9-04dab4afb90b/init-textfile/0.log"
Jul 02 22:19:50.558577 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:50.558503    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s2f62_1729cec6-1476-4357-be08-1a87ae637f46/kube-rbac-proxy-main/0.log"
Jul 02 22:19:50.598350 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:50.598319    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s2f62_1729cec6-1476-4357-be08-1a87ae637f46/kube-rbac-proxy-self/0.log"
Jul 02 22:19:50.619030 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:50.619002    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s2f62_1729cec6-1476-4357-be08-1a87ae637f46/openshift-state-metrics/0.log"
Jul 02 22:19:53.616969 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.616935    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"]
Jul 02 22:19:53.617443 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.617240    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964098c6-26dc-4a23-837b-b8506fbe19d2" containerName="main"
Jul 02 22:19:53.617443 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.617251    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="964098c6-26dc-4a23-837b-b8506fbe19d2" containerName="main"
Jul 02 22:19:53.617443 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.617267    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed41180-4929-4179-91c7-b3d7ed236a6b" containerName="main"
Jul 02 22:19:53.617443 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.617272    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed41180-4929-4179-91c7-b3d7ed236a6b" containerName="main"
Jul 02 22:19:53.617443 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.617340    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eed41180-4929-4179-91c7-b3d7ed236a6b" containerName="main"
Jul 02 22:19:53.617443 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.617348    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="964098c6-26dc-4a23-837b-b8506fbe19d2" containerName="main"
Jul 02 22:19:53.620198 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.620178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.622531 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.622504    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-92hjf\"/\"openshift-service-ca.crt\""
Jul 02 22:19:53.622639 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.622616    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-92hjf\"/\"kube-root-ca.crt\""
Jul 02 22:19:53.623327 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.623314    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-92hjf\"/\"default-dockercfg-m762d\""
Jul 02 22:19:53.627936 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.627915    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"]
Jul 02 22:19:53.652776 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.652754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-proc\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.652874 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.652783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-sys\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.652874 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.652832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65wjg\" (UniqueName: \"kubernetes.io/projected/0420a98c-5a32-442a-acbd-41a2c7825ca4-kube-api-access-65wjg\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.652949 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.652876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-podres\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.652949 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.652908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-lib-modules\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753547 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wjg\" (UniqueName: \"kubernetes.io/projected/0420a98c-5a32-442a-acbd-41a2c7825ca4-kube-api-access-65wjg\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753699 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-podres\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753699 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-lib-modules\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753800 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-proc\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753800 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753761    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-lib-modules\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753800 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-sys\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753800 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753728    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-podres\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753930 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753816    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-proc\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.753930 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.753823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0420a98c-5a32-442a-acbd-41a2c7825ca4-sys\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.762588 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.762569    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65wjg\" (UniqueName: \"kubernetes.io/projected/0420a98c-5a32-442a-acbd-41a2c7825ca4-kube-api-access-65wjg\") pod \"perf-node-gather-daemonset-srqgd\" (UID: \"0420a98c-5a32-442a-acbd-41a2c7825ca4\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:53.930696 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:53.930668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:54.054251 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:54.054230    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"]
Jul 02 22:19:54.057196 ip-10-0-131-117 kubenswrapper[2576]: W0702 22:19:54.057157    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0420a98c_5a32_442a_acbd_41a2c7825ca4.slice/crio-13ea1a3d789d4f6be568b006be9ae0dae00c6c53b979819f8654f3120b36d7c1 WatchSource:0}: Error finding container 13ea1a3d789d4f6be568b006be9ae0dae00c6c53b979819f8654f3120b36d7c1: Status 404 returned error can't find the container with id 13ea1a3d789d4f6be568b006be9ae0dae00c6c53b979819f8654f3120b36d7c1
Jul 02 22:19:54.111936 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:54.111908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd" event={"ID":"0420a98c-5a32-442a-acbd-41a2c7825ca4","Type":"ContainerStarted","Data":"13ea1a3d789d4f6be568b006be9ae0dae00c6c53b979819f8654f3120b36d7c1"}
Jul 02 22:19:55.118072 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:55.118029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd" event={"ID":"0420a98c-5a32-442a-acbd-41a2c7825ca4","Type":"ContainerStarted","Data":"957d7d58afa6663980ae229805dbb13d13e35c35a35449e0422a6b0dee663328"}
Jul 02 22:19:55.118483 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:55.118108    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:19:55.134295 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:55.134250    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd" podStartSLOduration=2.134233274 podStartE2EDuration="2.134233274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 22:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:19:55.132481875 +0000 UTC m=+2925.896012997" watchObservedRunningTime="2026-07-02 22:19:55.134233274 +0000 UTC m=+2925.897764372"
Jul 02 22:19:55.339931 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:55.339903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tmr6x_d86fe2fe-825f-47f2-b0e5-5dbee05aa11a/dns/0.log"
Jul 02 22:19:55.360041 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:55.360018    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tmr6x_d86fe2fe-825f-47f2-b0e5-5dbee05aa11a/kube-rbac-proxy/0.log"
Jul 02 22:19:55.450856 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:55.450818    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m9hbb_8f69a6f0-de6f-4fe0-9a3d-a2ac461195b2/dns-node-resolver/0.log"
Jul 02 22:19:56.074806 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:56.074777    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lbfjz_4bffaf14-d6f2-422c-8fab-b77bdea1460f/node-ca/0.log"
Jul 02 22:19:57.183150 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:57.183121    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45cbf66b-2cclq_5d977dd7-c20c-4217-9a84-4da38e9b211e/kube-auth-proxy/0.log"
Jul 02 22:19:58.182272 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:58.182236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hqk98_fb304ebd-fcbe-43b8-a6c9-a758e42b0017/serve-healthcheck-canary/0.log"
Jul 02 22:19:58.776122 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:58.776093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8w44t_00421924-e802-4ebc-b9fe-8caa1900be66/kube-rbac-proxy/0.log"
Jul 02 22:19:58.800965 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:58.800939    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8w44t_00421924-e802-4ebc-b9fe-8caa1900be66/exporter/0.log"
Jul 02 22:19:58.822430 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:19:58.822390    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8w44t_00421924-e802-4ebc-b9fe-8caa1900be66/extractor/0.log"
Jul 02 22:20:01.131701 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:01.131677    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-srqgd"
Jul 02 22:20:01.741569 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:01.741531    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-6m8ms_7ab74886-b86d-44b0-9f99-e181584e667a/manager/0.log"
Jul 02 22:20:01.761626 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:01.761602    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-6m8ms_7ab74886-b86d-44b0-9f99-e181584e667a/copy-manifests/0.log"
Jul 02 22:20:03.532438 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:03.532371    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bb99d9bb4-nwp5t_d54a2a55-1fea-4a7c-ab6c-4265eb16dc00/manager/0.log"
Jul 02 22:20:03.865200 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:03.865099    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45cbf66b-2cclq_5d977dd7-c20c-4217-9a84-4da38e9b211e/kube-auth-proxy/0.log"
Jul 02 22:20:05.525894 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:05.525867    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d45cbf66b-2cclq_5d977dd7-c20c-4217-9a84-4da38e9b211e/kube-auth-proxy/0.log"
Jul 02 22:20:10.021465 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.021435    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7b9m9_21be25c2-8baf-4144-9569-3bff04f3b515/kube-multus-additional-cni-plugins/0.log"
Jul 02 22:20:10.041839 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.041812    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7b9m9_21be25c2-8baf-4144-9569-3bff04f3b515/egress-router-binary-copy/0.log"
Jul 02 22:20:10.060634 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.060611    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7b9m9_21be25c2-8baf-4144-9569-3bff04f3b515/cni-plugins/0.log"
Jul 02 22:20:10.080075 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.080054    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7b9m9_21be25c2-8baf-4144-9569-3bff04f3b515/bond-cni-plugin/0.log"
Jul 02 22:20:10.100445 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.100415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7b9m9_21be25c2-8baf-4144-9569-3bff04f3b515/routeoverride-cni/0.log"
Jul 02 22:20:10.119645 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.119624    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7b9m9_21be25c2-8baf-4144-9569-3bff04f3b515/whereabouts-cni-bincopy/0.log"
Jul 02 22:20:10.139976 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.139958    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7b9m9_21be25c2-8baf-4144-9569-3bff04f3b515/whereabouts-cni/0.log"
Jul 02 22:20:10.543562 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.543530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vdjtc_7d91e315-8f33-467a-ae0e-7dafc94c0c1b/kube-multus/0.log"
Jul 02 22:20:10.564062 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.564036    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5brlj_2c71f14d-4178-48a4-a229-16e98c2fe8ba/network-metrics-daemon/0.log"
Jul 02 22:20:10.584562 ip-10-0-131-117 kubenswrapper[2576]: I0702 22:20:10.584540    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5brlj_2c71f14d-4178-48a4-a229-16e98c2fe8ba/kube-rbac-proxy/0.log"