Jul 07 18:42:26.142634 ip-10-0-135-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 18:42:26.142649 ip-10-0-135-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 18:42:26.142659 ip-10-0-135-133 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 18:42:26.142948 ip-10-0-135-133 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 18:42:36.253730 ip-10-0-135-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 18:42:36.253753 ip-10-0-135-133 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 163d12e925404a5ebfc69bee48ae07c7 --
Jul 07 18:44:08.038015 ip-10-0-135-133 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.490554    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497407    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497419    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497425    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497429    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497432    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497436    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497439    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:08.551962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497443    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497447    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497449    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497452    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497455    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497458    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497461    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497463    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497466    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497469    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497471    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497475    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497478    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497481    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497484    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497486    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497489    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497492    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497494    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497497    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:08.819967 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497499    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:08.574105 ip-10-0-135-133 systemd[1]: Started Kubernetes Kubelet.
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497502    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497504    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497507    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497509    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497512    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497514    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497517    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497519    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497522    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497524    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497527    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497530    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497533    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497535    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497538    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497541    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497543    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497546    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:08.832857 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497549    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497552    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497554    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497557    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497559    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497562    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497567    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497570    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497573    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497576    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497578    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497581    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497584    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497586    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497588    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497591    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497593    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497596    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497599    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:08.834892 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497602    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497605    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497608    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497610    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497613    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497616    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497620    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497622    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497626    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497630    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497633    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497635    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497638    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497641    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497654    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497658    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497661    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497665    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497668    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:08.836397 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497671    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497674    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497676    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497679    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497681    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497684    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497687    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497689    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497692    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497694    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497697    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497700    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497702    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497705    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.497708    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498482    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498489    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498492    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498495    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498498    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:08.837131 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498501    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498505    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498507    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498510    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498512    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498515    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498517    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498520    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498523    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498526    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498528    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498531    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498534    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498537    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498540    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498542    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498545    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498547    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498550    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498553    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:08.839485 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498556    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498558    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498561    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498563    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498566    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498568    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498571    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498573    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498576    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498578    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498581    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498583    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498586    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498589    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498591    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498594    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498596    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498599    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498601    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498607    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:08.842076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498610    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498614    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498617    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498619    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498622    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498624    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498627    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498629    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498632    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498634    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498636    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498640    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498642    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498645    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498648    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498652    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498656    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498659    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498662    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498664    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:08.844132 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498667    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498669    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498672    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498674    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498677    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498679    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498682    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498685    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498688    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498690    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498692    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498696    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498699    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498704    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498707    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498710    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498713    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498716    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498720    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:08.844957 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498723    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498727    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498730    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498732    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498735    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498753    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498756    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498759    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498761    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498764    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498767    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498770    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498772    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498775    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.498777    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499137    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499141    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499146    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499148    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:08.847140 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499152    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499154    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499157    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499160    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499162    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499166    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499169    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499171    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499174    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499176    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499179    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499181    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499184    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499187    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499189    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499191    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499194    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499197    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499199    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:08.849096 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499202    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499206    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499210    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499212    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499215    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499218    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499221    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499224    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499226    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499229    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499232    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499236    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499238    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499241    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499244    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499246    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499249    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499251    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499255    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:08.850032 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499258    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499260    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499263    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499266    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499268    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499271    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499274    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499276    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499278    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499281    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499283    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499286    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499290    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499294    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499297    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499300    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499303    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499305    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499308    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499310    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:08.851072 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499313    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499315    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499318    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499320    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499324    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499326    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499329    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499332    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499335    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499338    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499340    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499344    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499346    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499349    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499351    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499354    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499357    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499360    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499362    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499365    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:08.852024 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499367    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499370    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499373    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499375    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499378    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499380    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499383    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499385    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499388    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499390    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499392    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499395    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499397    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499401    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499404    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499407    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.499412    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499488    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499506    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499514    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499521    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 18:44:08.852631 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499527    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499530    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499535    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499539    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499542    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499545    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499549    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499552    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499555    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499558    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499561    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499564    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499567    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499570    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499574    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499577    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499580    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499583    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499586    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499590    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499593    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499596    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499599    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499602    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 18:44:08.853440 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499604    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499607    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499610    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499615    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499619    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499622    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499625    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499627    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499630    2581 flags.go:64] FLAG: --enable-server="true"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499634    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499639    2581 flags.go:64] FLAG: --event-burst="100"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499642    2581 flags.go:64] FLAG: --event-qps="50"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499645    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499648    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499650    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499654    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499657    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499660    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499662    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499665    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499668    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499671    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499674    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499676    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499679    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 18:44:08.854214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499682    2581 flags.go:64] FLAG: --feature-gates=""
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499688    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499691    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499693    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499696    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499699    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499702    2581 flags.go:64] FLAG: --help="false"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499705    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-133.ec2.internal"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499708    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499711    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499715    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499718    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499722    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499725    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499727    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499730    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499733    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499750    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499754    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499757    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499759    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499762    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499765    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499768    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 18:44:08.854919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499771    2581 flags.go:64] FLAG: --lock-file=""
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499774    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499776    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499779    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499784    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499787    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499790    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499793    2581 flags.go:64] FLAG: --logging-format="text"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499795    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499798    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499801    2581 flags.go:64] FLAG: --manifest-url=""
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499804    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499809    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499812    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499816    2581 flags.go:64] FLAG: --max-pods="110"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499818    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499821    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499824    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499828    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499832    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499835    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499838    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499845    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499848    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499851    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 18:44:08.855547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499855    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499858    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499864    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499867    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499870    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499873    2581 flags.go:64] FLAG: --port="10250"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499876    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499879    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ec1e936c4fc9732"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499882    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499885    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499888    2581 flags.go:64] FLAG: --register-node="true"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499891    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499894    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499897    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499900    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499902    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499906    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499909    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499912    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499914    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499917    2581 flags.go:64] FLAG: --runonce="false"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499920    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499922    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499925    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499928    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 18:44:08.856280 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499932    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499935    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499938    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499941    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499944    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499947    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499949    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499952    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499956    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499960    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499963    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499968    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499971    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499974    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499981    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499984    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499987    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499990    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499992    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499995    2581 flags.go:64] FLAG: --v="2"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.499999    2581 flags.go:64] FLAG: --version="false"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.500003    2581 flags.go:64] FLAG: --vmodule=""
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.500006    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.500009    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500121    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:08.857235 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500126    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500128    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500131    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500134    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500137    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500139    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500142    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500146    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500149    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500151    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500154    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500157    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500159    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500162    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500164    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500168    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500171    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500174    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500177    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500179    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:08.857962 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500182    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500185    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500188    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500190    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500195    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500198    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500201    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500204    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500207    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500209    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500212    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500214    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500217    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500219    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500222    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500224    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500227    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500229    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500232    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:09.042732 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500235    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500238    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500240    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500243    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500245    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500248    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500250    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500253    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500257    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500259    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500262    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500265    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500267    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500270    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500272    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500275    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500278    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500280    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500283    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500286    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:09.043693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500288    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500291    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500293    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500296    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500299    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500301    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500304    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500306    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500309    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500311    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500315    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500318    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500323    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500326    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500329    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500333    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500336    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500339    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:09.044314 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500342    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500346    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500350    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500353    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500355    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500358    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500361    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500364    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500366    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500369    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500371    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500374    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500377    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500379    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500382    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500384    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500387    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500389    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500392    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500394    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:09.044861 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.500397    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.501101    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.508143    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.508156    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.509083    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.509090    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509144    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509149    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509152    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509155    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509159    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509162    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509165    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509168    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509171    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:09.045386 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509174    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509178    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509182    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509186    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509190    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509193    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509195    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509199    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509201    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509204    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509206    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509209    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509212    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509215    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509218    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509220    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509223    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509225    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509228    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:09.045874 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509231    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509234    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509237    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509239    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509242    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509244    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509247    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509249    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509253    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509257    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509260    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509262    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509265    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509268    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509271    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509274    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509277    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509280    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509283    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:09.046381 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509286    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509289    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509291    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509294    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509296    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509299    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509302    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509305    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509307    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509309    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509312    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509314    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509321    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509323    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509326    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509329    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509332    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509334    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509338    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509343    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:09.046936 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509346    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509349    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509352    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509354    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509357    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509360    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509363    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509366    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509368    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509371    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509374    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509377    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509380    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509382    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509385    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509388    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509390    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509393    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509395    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:09.047487 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509398    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509400    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509403    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509406    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509408    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509412    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509417    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509419    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509422    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509424    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509427    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509429    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509432    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.509437    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509562    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:09.048076 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509567    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509570    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509573    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509576    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509579    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509581    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509584    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509587    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509589    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509591    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509595    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509597    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509599    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509602    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509605    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509607    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509610    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509612    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509615    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509617    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:09.048489 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509620    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509622    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509625    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509631    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509633    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509636    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509639    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509641    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509657    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509660    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509662    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509664    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509667    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509670    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509672    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509675    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509677    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509679    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509682    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509685    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:09.049062 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509687    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509690    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509694    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509698    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509701    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509704    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509706    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509709    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509712    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509714    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509716    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509720    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509724    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509726    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509729    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509734    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509754    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509758    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509761    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:09.049580 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509764    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509767    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509770    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509773    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509775    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509778    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509780    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509783    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509785    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509788    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509790    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509793    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509795    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509798    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509800    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509804    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509807    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509811    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509814    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:09.050143 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509817    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509820    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509823    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509825    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509828    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509830    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509832    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509835    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509838    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509844    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509846    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509849    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509851    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509854    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509856    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509859    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509861    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509864    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509866    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:09.050642 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:08.509869    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.509874    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.509963    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.512306    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.514019    2581 server.go:1019] "Starting client certificate rotation"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.514115    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.514179    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.516730    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.522339    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.535783    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.538311    2581 log.go:25] "Validated CRI v1 image API"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.539041    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 18:44:09.051265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.544721    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c66b5da8-66c9-4da0-9a82-b71935e10d51:/dev/nvme0n1p3 e8e6f241-3967-452b-9dc6-b57b14525c12:/dev/nvme0n1p4]
Jul 07 18:44:09.051604 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.544735    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 18:44:09.051704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.548997    2581 manager.go:216] Machine: {Timestamp:2026-07-07 18:44:08.548419301 +0000 UTC m=+0.378822196 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098716 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f055b33b2bd909ed361520d7dabdc SystemUUID:ec2f055b-33b2-bd90-9ed3-61520d7dabdc BootID:163d12e9-2540-4a5e-bfc6-9bee48ae07c7 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:95:13:32:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:95:13:32:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:15:fe:4b:53:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 18:44:09.051704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.549099    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 18:44:09.051704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.549169    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 18:44:09.051704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.552069    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:44:09.051704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.552856    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 18:44:09.051704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.552889    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 18:44:09.051704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.553753    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.553766    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.553775    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.553789    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.555676    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560405    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560516    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560543    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560554    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560568    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560578    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560587    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560947    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.560971    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.563359    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.565948    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.565988    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568466    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568482    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568489    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568501    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568510    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568516    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568524    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568530    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568537    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568543    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568552    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.568561    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.569540    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.569554    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.573207    2581 server.go:1268] "Started kubelet"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.573292    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.573498    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.573836    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.573910    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.574341    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.574346    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.575322    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 18:44:09.051981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.575882    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.580160    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.581459    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-133.ec2.internal.18c016302aed8603  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-133.ec2.internal,UID:ip-10-0-135-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-133.ec2.internal,},FirstTimestamp:2026-07-07 18:44:08.573167107 +0000 UTC m=+0.403570005,LastTimestamp:2026-07-07 18:44:08.573167107 +0000 UTC m=+0.403570005,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-133.ec2.internal,}"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.585733    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.585756    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.585903    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586471    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586472    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586492    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586605    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586616    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586684    2581 factory.go:55] Registering systemd factory
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586696    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586892    2581 factory.go:153] Registering CRI-O factory
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586907    2581 factory.go:223] Registration of the crio container factory successfully
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586951    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586972    2581 factory.go:103] Registering Raw factory
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.586985    2581 manager.go:1196] Started watching for new ooms in manager
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.587333    2581 manager.go:349] Starting recovery of all containers
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.594059    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bdb5"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.596041    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.596182    2581 manager.go:354] Recovery completed
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.596523    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.600667    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.602615    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bdb5"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.602650    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.602702    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.602718    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.603406    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.603417    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.603440    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.603460    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:09.053025 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.604308    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.604325    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.604335    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.606794    2581 policy_none.go:49] "None policy: Start"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.606808    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.606819    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.608770    2581 policy_none.go:47] "Start"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.662549    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.663733    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.663793    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.663813    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.663848    2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.665868    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.686979    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.764182    2581 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.787407    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.802496    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-133.ec2.internal\" not found" node="ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.872290    2581 manager.go:337] "Starting Device Plugin manager"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.872364    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.872377    2581 server.go:87] "Starting device plugin registration server"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.872633    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.872643    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.872706    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.872806    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.872814    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.873335    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.873376    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.965005    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal"]
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.965080    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.966705    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.966752    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.966772    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969063    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969212    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969776    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969806    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:09.055984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969817    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969778    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969882    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.969896    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.972061    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.972086    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.972693    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.972712    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.972720    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.972720    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.973378    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.973399    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.973410    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.973426    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.983778    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.983793    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-133.ec2.internal\": node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.988166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc75046a7b2ae9a84906f50fc76e9a1e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"bc75046a7b2ae9a84906f50fc76e9a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.988186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc75046a7b2ae9a84906f50fc76e9a1e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"bc75046a7b2ae9a84906f50fc76e9a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:08.988203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d21a0c9a3a458b1cdd0669a4a363f26-config\") pod \"kube-apiserver-proxy-ip-10-0-135-133.ec2.internal\" (UID: \"2d21a0c9a3a458b1cdd0669a4a363f26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:08.996274    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-133.ec2.internal\" not found" node="ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:09.000234    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-133.ec2.internal\" not found" node="ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.057002 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:09.001331    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.198722 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.089240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc75046a7b2ae9a84906f50fc76e9a1e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"bc75046a7b2ae9a84906f50fc76e9a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.198722 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.089268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc75046a7b2ae9a84906f50fc76e9a1e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"bc75046a7b2ae9a84906f50fc76e9a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.198722 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.089292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d21a0c9a3a458b1cdd0669a4a363f26-config\") pod \"kube-apiserver-proxy-ip-10-0-135-133.ec2.internal\" (UID: \"2d21a0c9a3a458b1cdd0669a4a363f26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.198722 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.089339    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d21a0c9a3a458b1cdd0669a4a363f26-config\") pod \"kube-apiserver-proxy-ip-10-0-135-133.ec2.internal\" (UID: \"2d21a0c9a3a458b1cdd0669a4a363f26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.198722 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.089390    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc75046a7b2ae9a84906f50fc76e9a1e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"bc75046a7b2ae9a84906f50fc76e9a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.198722 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.089423    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc75046a7b2ae9a84906f50fc76e9a1e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal\" (UID: \"bc75046a7b2ae9a84906f50fc76e9a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.198722 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:09.102262    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.339225 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:09.202771    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.339225 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.300226    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:09.339225 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:09.303337    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:09.339225 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:09.303891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:10.744702 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:09.403783    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:10.880457 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:10.780759    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:10.880457 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:10.789913    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 18:44:10.880457 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:10.790046    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:44:10.881373 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:10.881282    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:11.010356 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:10.884352    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:39:09 +0000 UTC" deadline="2028-02-20 12:53:44.251410008 +0000 UTC"
Jul 07 18:44:11.010356 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:10.884375    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14226h9m33.367038106s"
Jul 07 18:44:11.010356 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:10.982038    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:11.141021 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.070722    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:11.141021 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.084302    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:11.279573 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.151267    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:11.279573 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.185142    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:11.398083 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.285497    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:11.398083 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.386544    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-133.ec2.internal\" not found"
Jul 07 18:44:11.398083 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:11.393791    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc75046a7b2ae9a84906f50fc76e9a1e.slice/crio-a19c2513b431071598a883f6d9a49b2bbb02f5127d5fb003c5baa307e9c347c8 WatchSource:0}: Error finding container a19c2513b431071598a883f6d9a49b2bbb02f5127d5fb003c5baa307e9c347c8: Status 404 returned error can't find the container with id a19c2513b431071598a883f6d9a49b2bbb02f5127d5fb003c5baa307e9c347c8
Jul 07 18:44:11.398083 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:11.394178    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d21a0c9a3a458b1cdd0669a4a363f26.slice/crio-3bf9edd35ad66b117234cd13ecc287c3043aa2da5b4c986d4bb6f135fc6e3c66 WatchSource:0}: Error finding container 3bf9edd35ad66b117234cd13ecc287c3043aa2da5b4c986d4bb6f135fc6e3c66: Status 404 returned error can't find the container with id 3bf9edd35ad66b117234cd13ecc287c3043aa2da5b4c986d4bb6f135fc6e3c66
Jul 07 18:44:11.401688 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.401470    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:44:11.568745 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.431752    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:11.568745 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.463048    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:11.568745 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.483769    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:44:11.568745 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.484897    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal"
Jul 07 18:44:11.568745 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.497125    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.838645    2581 apiserver.go:52] "Watching apiserver"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.845657    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.846032    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-452fq","openshift-multus/multus-hwwnl","openshift-multus/network-metrics-daemon-2gm48","kube-system/konnectivity-agent-tpnd4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92","openshift-image-registry/node-ca-wqprq","openshift-network-diagnostics/network-check-target-jk7kq","openshift-network-operator/iptables-alerter-gsg6k","openshift-ovn-kubernetes/ovnkube-node-dkkk8","kube-system/global-pull-secret-syncer-8jg9g","kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l2d52","openshift-dns/node-resolver-dlcv4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal"]
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.849723    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.849783    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.851745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.853821    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.853845    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.853822    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.853916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dvfp5\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.853947    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.855973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.858081    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.858114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.858198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7gxkb\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.858227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.860220    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.860289    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r4gp8\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.860480    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.860638    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.861083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.862674    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.863287    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.863297    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.863331    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 18:44:11.866740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.863426    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-grmxz\""
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-socket-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61183db6-1671-43b3-bc1e-84cf45d04cde-konnectivity-ca\") pod \"konnectivity-agent-tpnd4\" (UID: \"61183db6-1671-43b3-bc1e-84cf45d04cde\") " pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-slash\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-run-netns\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-cni-netd\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-env-overrides\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-kubelet\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-etc-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4963235-609b-4f16-9e27-4a4bfe6ea15a-hosts-file\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-device-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-systemd-units\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-systemd\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.872566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-node-log\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4963235-609b-4f16-9e27-4a4bfe6ea15a-tmp-dir\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.871997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk2x2\" (UniqueName: \"kubernetes.io/projected/9c2883e3-900b-479a-a926-33e779cf95b4-kube-api-access-dk2x2\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61183db6-1671-43b3-bc1e-84cf45d04cde-agent-certs\") pod \"konnectivity-agent-tpnd4\" (UID: \"61183db6-1671-43b3-bc1e-84cf45d04cde\") " pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed1af96-65a9-4104-aacc-e681726d1a6b-host\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed1af96-65a9-4104-aacc-e681726d1a6b-serviceca\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-ovn\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-cni-bin\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.874027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-etc-selinux\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-sys-fs\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-var-lib-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-ovnkube-config\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml4lm\" (UniqueName: \"kubernetes.io/projected/55f6885e-3922-4075-8d28-3ef4439500dc-kube-api-access-ml4lm\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8zqg\" (UniqueName: \"kubernetes.io/projected/fed1af96-65a9-4104-aacc-e681726d1a6b-kube-api-access-r8zqg\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f6885e-3922-4075-8d28-3ef4439500dc-ovn-node-metrics-cert\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwhw\" (UniqueName: \"kubernetes.io/projected/f4963235-609b-4f16-9e27-4a4bfe6ea15a-kube-api-access-6wwhw\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-registration-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tjp4\" (UniqueName: \"kubernetes.io/projected/5c1cf8a9-254d-4259-a332-cc239e20633d-kube-api-access-2tjp4\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-log-socket\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.874704 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.872571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-ovnkube-script-lib\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.875539 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.874780    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.884335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.886646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.886807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9vlw\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.887499    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.887503    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.887502    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.887509    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.887509    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.887610    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.888740    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.888880    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.888886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.888989    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ss5f6\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.888995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.891045    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.891053    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.891378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.891443    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.891904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.892347    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rbjh8\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.893914    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.896207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.896553    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tg8zv\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.896818    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.896881    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.897073    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.898640    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.898919    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qswps\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.899186    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 18:44:11.961965 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.900413    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z78h6"
Jul 07 18:44:11.964598 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.910794    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z78h6"
Jul 07 18:44:11.964598 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.945075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" event={"ID":"2d21a0c9a3a458b1cdd0669a4a363f26","Type":"ContainerStarted","Data":"3bf9edd35ad66b117234cd13ecc287c3043aa2da5b4c986d4bb6f135fc6e3c66"}
Jul 07 18:44:11.964598 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.946293    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" event={"ID":"bc75046a7b2ae9a84906f50fc76e9a1e","Type":"ContainerStarted","Data":"a19c2513b431071598a883f6d9a49b2bbb02f5127d5fb003c5baa307e9c347c8"}
Jul 07 18:44:11.964598 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.963775    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-cni-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-iptables-alerter-script\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysconfig\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-cni-netd\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972953    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-cni-netd\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.972991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-env-overrides\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-socket-dir-parent\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64f1ff43-b922-41c3-9e78-59920705e8c3-dbus\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-etc-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229dd\" (UniqueName: \"kubernetes.io/projected/34b25510-f746-421c-8b6c-e848f2cd64c3-kube-api-access-229dd\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973161    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-etc-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.976342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4963235-609b-4f16-9e27-4a4bfe6ea15a-hosts-file\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-device-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-systemd-units\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973288    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-device-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973330    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-systemd-units\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-cnibin\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-netns\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973365    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4963235-609b-4f16-9e27-4a4bfe6ea15a-tmp-dir\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973399    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-cni-bin\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.979724 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973481    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4963235-609b-4f16-9e27-4a4bfe6ea15a-hosts-file\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-hostroot\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-conf-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-kubernetes\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-env-overrides\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-systemd\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-cnibin\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61183db6-1671-43b3-bc1e-84cf45d04cde-agent-certs\") pod \"konnectivity-agent-tpnd4\" (UID: \"61183db6-1671-43b3-bc1e-84cf45d04cde\") " pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4963235-609b-4f16-9e27-4a4bfe6ea15a-tmp-dir\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed1af96-65a9-4104-aacc-e681726d1a6b-host\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973734    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed1af96-65a9-4104-aacc-e681726d1a6b-host\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed1af96-65a9-4104-aacc-e681726d1a6b-serviceca\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-ovn\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-cni-bin\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.980563 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973895    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-cni-bin\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973895    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-ovn\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdwp2\" (UniqueName: \"kubernetes.io/projected/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-kube-api-access-bdwp2\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-sys-fs\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973965    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974055    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-sys-fs\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.974065    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.974142    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:12.474121733 +0000 UTC m=+3.028013200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.973990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-ovnkube-config\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml4lm\" (UniqueName: \"kubernetes.io/projected/55f6885e-3922-4075-8d28-3ef4439500dc-kube-api-access-ml4lm\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974434    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-ovnkube-config\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-kubelet\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-multus-certs\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.983986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysctl-conf\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-sys\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8zqg\" (UniqueName: \"kubernetes.io/projected/fed1af96-65a9-4104-aacc-e681726d1a6b-kube-api-access-r8zqg\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63474689-bf86-4dd1-8f0d-c50096f6e1b5-cni-binary-copy\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brl5r\" (UniqueName: \"kubernetes.io/projected/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-kube-api-access-brl5r\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-lib-modules\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-var-lib-kubelet\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-system-cni-dir\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-os-release\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwhw\" (UniqueName: \"kubernetes.io/projected/f4963235-609b-4f16-9e27-4a4bfe6ea15a-kube-api-access-6wwhw\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-registration-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tjp4\" (UniqueName: \"kubernetes.io/projected/5c1cf8a9-254d-4259-a332-cc239e20633d-kube-api-access-2tjp4\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.974973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-log-socket\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.984864 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-ovnkube-script-lib\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975030    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64f1ff43-b922-41c3-9e78-59920705e8c3-kubelet-config\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975028    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed1af96-65a9-4104-aacc-e681726d1a6b-serviceca\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975087    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-log-socket\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975442    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-registration-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-tmp\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-socket-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61183db6-1671-43b3-bc1e-84cf45d04cde-konnectivity-ca\") pod \"konnectivity-agent-tpnd4\" (UID: \"61183db6-1671-43b3-bc1e-84cf45d04cde\") " pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-slash\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975576    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f6885e-3922-4075-8d28-3ef4439500dc-ovnkube-script-lib\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975621    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-run-netns\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-run-netns\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-etc-kubernetes\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.987873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-kubelet\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh722\" (UniqueName: \"kubernetes.io/projected/63474689-bf86-4dd1-8f0d-c50096f6e1b5-kube-api-access-wh722\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-host\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975778    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-kubelet\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-tuned\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-systemd\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-node-log\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysctl-d\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-run\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk2x2\" (UniqueName: \"kubernetes.io/projected/9c2883e3-900b-479a-a926-33e779cf95b4-kube-api-access-dk2x2\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-os-release\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.975993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-k8s-cni-cncf-io\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976008    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-host-slash\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.988729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-daemon-config\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-host-slash\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976081    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-run-systemd\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-etc-selinux\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-var-lib-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-system-cni-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-cni-multus\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-modprobe-d\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f6885e-3922-4075-8d28-3ef4439500dc-ovn-node-metrics-cert\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976393    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61183db6-1671-43b3-bc1e-84cf45d04cde-konnectivity-ca\") pod \"konnectivity-agent-tpnd4\" (UID: \"61183db6-1671-43b3-bc1e-84cf45d04cde\") " pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976468    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-node-log\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976728    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f6885e-3922-4075-8d28-3ef4439500dc-var-lib-openvswitch\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.992086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-socket-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976794    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-etc-selinux\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.976866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c1cf8a9-254d-4259-a332-cc239e20633d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.978008    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61183db6-1671-43b3-bc1e-84cf45d04cde-agent-certs\") pod \"konnectivity-agent-tpnd4\" (UID: \"61183db6-1671-43b3-bc1e-84cf45d04cde\") " pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.978771    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f6885e-3922-4075-8d28-3ef4439500dc-ovn-node-metrics-cert\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.983569    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8zqg\" (UniqueName: \"kubernetes.io/projected/fed1af96-65a9-4104-aacc-e681726d1a6b-kube-api-access-r8zqg\") pod \"node-ca-wqprq\" (UID: \"fed1af96-65a9-4104-aacc-e681726d1a6b\") " pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.984094    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.984115    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.984128    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f8dzk for pod openshift-network-diagnostics/network-check-target-jk7kq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:11.984195    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk podName:ad5b68c5-5cd2-4c61-a3db-cd1681007742 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:12.484176988 +0000 UTC m=+3.038068469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f8dzk" (UniqueName: "kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk") pod "network-check-target-jk7kq" (UID: "ad5b68c5-5cd2-4c61-a3db-cd1681007742") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.985700    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tjp4\" (UniqueName: \"kubernetes.io/projected/5c1cf8a9-254d-4259-a332-cc239e20633d-kube-api-access-2tjp4\") pod \"aws-ebs-csi-driver-node-2tw92\" (UID: \"5c1cf8a9-254d-4259-a332-cc239e20633d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.985975    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml4lm\" (UniqueName: \"kubernetes.io/projected/55f6885e-3922-4075-8d28-3ef4439500dc-kube-api-access-ml4lm\") pod \"ovnkube-node-dkkk8\" (UID: \"55f6885e-3922-4075-8d28-3ef4439500dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.987038    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwhw\" (UniqueName: \"kubernetes.io/projected/f4963235-609b-4f16-9e27-4a4bfe6ea15a-kube-api-access-6wwhw\") pod \"node-resolver-dlcv4\" (UID: \"f4963235-609b-4f16-9e27-4a4bfe6ea15a\") " pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:11.992925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:11.987333    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk2x2\" (UniqueName: \"kubernetes.io/projected/9c2883e3-900b-479a-a926-33e779cf95b4-kube-api-access-dk2x2\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:12.061297 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.049359    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-cni-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-iptables-alerter-script\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysconfig\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-socket-dir-parent\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64f1ff43-b922-41c3-9e78-59920705e8c3-dbus\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229dd\" (UniqueName: \"kubernetes.io/projected/34b25510-f746-421c-8b6c-e848f2cd64c3-kube-api-access-229dd\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-cnibin\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-netns\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-cni-bin\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-hostroot\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-conf-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.131300 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077449    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-cni-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-kubernetes\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-systemd\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-cnibin\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077518    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64f1ff43-b922-41c3-9e78-59920705e8c3-dbus\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwp2\" (UniqueName: \"kubernetes.io/projected/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-kube-api-access-bdwp2\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-kubelet\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-multus-certs\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysctl-conf\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-sys\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63474689-bf86-4dd1-8f0d-c50096f6e1b5-cni-binary-copy\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brl5r\" (UniqueName: \"kubernetes.io/projected/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-kube-api-access-brl5r\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-lib-modules\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.132157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-var-lib-kubelet\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-system-cni-dir\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-os-release\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64f1ff43-b922-41c3-9e78-59920705e8c3-kubelet-config\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-tmp\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-etc-kubernetes\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh722\" (UniqueName: \"kubernetes.io/projected/63474689-bf86-4dd1-8f0d-c50096f6e1b5-kube-api-access-wh722\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.077980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-host\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-tuned\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078028    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-iptables-alerter-script\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysctl-d\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078083    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysconfig\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-run\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-os-release\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.137186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-k8s-cni-cncf-io\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-daemon-config\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-host-slash\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-system-cni-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-cni-multus\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-modprobe-d\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078399    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-socket-dir-parent\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-var-lib-kubelet\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078495    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-system-cni-dir\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078510    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-modprobe-d\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078555    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64f1ff43-b922-41c3-9e78-59920705e8c3-kubelet-config\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078558    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-host-slash\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-cnibin\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078691    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-netns\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.138048 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078695    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078733    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-cni-bin\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078755    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-system-cni-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078777    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-hostroot\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078797    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-cni-multus\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078818    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-conf-dir\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078868    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-kubernetes\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078922    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-systemd\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078963    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-cnibin\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.078993    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63474689-bf86-4dd1-8f0d-c50096f6e1b5-multus-daemon-config\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079098    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysctl-d\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079148    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-run\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079188    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-var-lib-kubelet\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079207    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-os-release\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079239    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-multus-certs\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.215614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079245    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-host-run-k8s-cni-cncf-io\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079363    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079390    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-sysctl-conf\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079436    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63474689-bf86-4dd1-8f0d-c50096f6e1b5-etc-kubernetes\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.079633    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.079687    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret podName:64f1ff43-b922-41c3-9e78-59920705e8c3 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:12.579670848 +0000 UTC m=+3.133562326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret") pod "global-pull-secret-syncer-8jg9g" (UID: "64f1ff43-b922-41c3-9e78-59920705e8c3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079725    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63474689-bf86-4dd1-8f0d-c50096f6e1b5-cni-binary-copy\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079839    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079848    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-lib-modules\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079906    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34b25510-f746-421c-8b6c-e848f2cd64c3-os-release\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.079955    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-sys\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.080015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-host\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.080457    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34b25510-f746-421c-8b6c-e848f2cd64c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.081955    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-tmp\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.219113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.083126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-etc-tuned\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.088845    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brl5r\" (UniqueName: \"kubernetes.io/projected/c9f88930-6f75-42bc-afcb-fa26a9ebde8e-kube-api-access-brl5r\") pod \"iptables-alerter-gsg6k\" (UID: \"c9f88930-6f75-42bc-afcb-fa26a9ebde8e\") " pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.088966    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdwp2\" (UniqueName: \"kubernetes.io/projected/e6d0c729-f21f-4cab-8ac7-e3308ce26c7d-kube-api-access-bdwp2\") pod \"tuned-l2d52\" (UID: \"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d\") " pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.091191    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-229dd\" (UniqueName: \"kubernetes.io/projected/34b25510-f746-421c-8b6c-e848f2cd64c3-kube-api-access-229dd\") pod \"multus-additional-cni-plugins-452fq\" (UID: \"34b25510-f746-421c-8b6c-e848f2cd64c3\") " pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.092465    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh722\" (UniqueName: \"kubernetes.io/projected/63474689-bf86-4dd1-8f0d-c50096f6e1b5-kube-api-access-wh722\") pod \"multus-hwwnl\" (UID: \"63474689-bf86-4dd1-8f0d-c50096f6e1b5\") " pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.161947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlcv4"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.170844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.176925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wqprq"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.179079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.186938    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61183db6_1671_43b3_bc1e_84cf45d04cde.slice/crio-74524914139f241c95d4fa9681bf55ebfa71cd049067e128a7cdef5aabd29bcd WatchSource:0}: Error finding container 74524914139f241c95d4fa9681bf55ebfa71cd049067e128a7cdef5aabd29bcd: Status 404 returned error can't find the container with id 74524914139f241c95d4fa9681bf55ebfa71cd049067e128a7cdef5aabd29bcd
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.190025    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed1af96_65a9_4104_aacc_e681726d1a6b.slice/crio-9e26139f05f10b74fdd04833b7410f5032af456b24b092f4469b195bb055a76d WatchSource:0}: Error finding container 9e26139f05f10b74fdd04833b7410f5032af456b24b092f4469b195bb055a76d: Status 404 returned error can't find the container with id 9e26139f05f10b74fdd04833b7410f5032af456b24b092f4469b195bb055a76d
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.192114    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.194739    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1cf8a9_254d_4259_a332_cc239e20633d.slice/crio-2806df5a5940a8ecfa176f16e013b3bdd01bef9ea47663eefbdb0b1691158c63 WatchSource:0}: Error finding container 2806df5a5940a8ecfa176f16e013b3bdd01bef9ea47663eefbdb0b1691158c63: Status 404 returned error can't find the container with id 2806df5a5940a8ecfa176f16e013b3bdd01bef9ea47663eefbdb0b1691158c63
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.200266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-452fq"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.204349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hwwnl"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.205417    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f6885e_3922_4075_8d28_3ef4439500dc.slice/crio-2eba72736a1e2be1b74317d9c35cb3e5c1a635c8a98ed6f749d93b60fbc6c69b WatchSource:0}: Error finding container 2eba72736a1e2be1b74317d9c35cb3e5c1a635c8a98ed6f749d93b60fbc6c69b: Status 404 returned error can't find the container with id 2eba72736a1e2be1b74317d9c35cb3e5c1a635c8a98ed6f749d93b60fbc6c69b
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.212939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gsg6k"
Jul 07 18:44:12.219982 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.216877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2d52"
Jul 07 18:44:12.228372 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.224098    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b25510_f746_421c_8b6c_e848f2cd64c3.slice/crio-95942dcf91233dc46800daf0c32f9eb01541ac0ba93c17bdf058acf7257dbe18 WatchSource:0}: Error finding container 95942dcf91233dc46800daf0c32f9eb01541ac0ba93c17bdf058acf7257dbe18: Status 404 returned error can't find the container with id 95942dcf91233dc46800daf0c32f9eb01541ac0ba93c17bdf058acf7257dbe18
Jul 07 18:44:12.234668 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.232321    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d0c729_f21f_4cab_8ac7_e3308ce26c7d.slice/crio-808b049e4d2f5e9deebcd4e972cabb1a3756f721673fd7a3095ee8187f64eea0 WatchSource:0}: Error finding container 808b049e4d2f5e9deebcd4e972cabb1a3756f721673fd7a3095ee8187f64eea0: Status 404 returned error can't find the container with id 808b049e4d2f5e9deebcd4e972cabb1a3756f721673fd7a3095ee8187f64eea0
Jul 07 18:44:12.234668 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.233098    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63474689_bf86_4dd1_8f0d_c50096f6e1b5.slice/crio-3d97737fbcc427936890de6db39b370c9ff364138b49b4b3ed94c42ffb319c9d WatchSource:0}: Error finding container 3d97737fbcc427936890de6db39b370c9ff364138b49b4b3ed94c42ffb319c9d: Status 404 returned error can't find the container with id 3d97737fbcc427936890de6db39b370c9ff364138b49b4b3ed94c42ffb319c9d
Jul 07 18:44:12.237715 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:12.237214    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f88930_6f75_42bc_afcb_fa26a9ebde8e.slice/crio-cfa22f3fb3331e58f9217a6be9f09423564fc0487dcc22c589ac6c57c833d109 WatchSource:0}: Error finding container cfa22f3fb3331e58f9217a6be9f09423564fc0487dcc22c589ac6c57c833d109: Status 404 returned error can't find the container with id cfa22f3fb3331e58f9217a6be9f09423564fc0487dcc22c589ac6c57c833d109
Jul 07 18:44:12.481391 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.481311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:12.481547 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.481469    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:12.481547 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.481545    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:13.481525 +0000 UTC m=+4.035416479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:12.581934 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.581899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:12.582090 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.581969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:12.582090 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.582027    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:12.582241 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.582103    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret podName:64f1ff43-b922-41c3-9e78-59920705e8c3 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:13.582082596 +0000 UTC m=+4.135974065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret") pod "global-pull-secret-syncer-8jg9g" (UID: "64f1ff43-b922-41c3-9e78-59920705e8c3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:12.582241 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.582114    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:12.582241 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.582130    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:12.582241 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.582138    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f8dzk for pod openshift-network-diagnostics/network-check-target-jk7kq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:12.582241 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:12.582188    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk podName:ad5b68c5-5cd2-4c61-a3db-cd1681007742 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:13.582176197 +0000 UTC m=+4.136067661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8dzk" (UniqueName: "kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk") pod "network-check-target-jk7kq" (UID: "ad5b68c5-5cd2-4c61-a3db-cd1681007742") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:12.915019 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.914873    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:39:11 +0000 UTC" deadline="2027-12-04 14:20:18.312853719 +0000 UTC"
Jul 07 18:44:12.915019 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.914918    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12355h36m5.397940539s"
Jul 07 18:44:12.965170 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.965128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gsg6k" event={"ID":"c9f88930-6f75-42bc-afcb-fa26a9ebde8e","Type":"ContainerStarted","Data":"cfa22f3fb3331e58f9217a6be9f09423564fc0487dcc22c589ac6c57c833d109"}
Jul 07 18:44:12.990000 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:12.989863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"2eba72736a1e2be1b74317d9c35cb3e5c1a635c8a98ed6f749d93b60fbc6c69b"}
Jul 07 18:44:13.000898 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.000819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2d52" event={"ID":"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d","Type":"ContainerStarted","Data":"808b049e4d2f5e9deebcd4e972cabb1a3756f721673fd7a3095ee8187f64eea0"}
Jul 07 18:44:13.013666 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.013389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hwwnl" event={"ID":"63474689-bf86-4dd1-8f0d-c50096f6e1b5","Type":"ContainerStarted","Data":"3d97737fbcc427936890de6db39b370c9ff364138b49b4b3ed94c42ffb319c9d"}
Jul 07 18:44:13.019629 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.019564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerStarted","Data":"95942dcf91233dc46800daf0c32f9eb01541ac0ba93c17bdf058acf7257dbe18"}
Jul 07 18:44:13.025039 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.024952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92" event={"ID":"5c1cf8a9-254d-4259-a332-cc239e20633d","Type":"ContainerStarted","Data":"2806df5a5940a8ecfa176f16e013b3bdd01bef9ea47663eefbdb0b1691158c63"}
Jul 07 18:44:13.030380 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.030304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wqprq" event={"ID":"fed1af96-65a9-4104-aacc-e681726d1a6b","Type":"ContainerStarted","Data":"9e26139f05f10b74fdd04833b7410f5032af456b24b092f4469b195bb055a76d"}
Jul 07 18:44:13.032938 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.032880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tpnd4" event={"ID":"61183db6-1671-43b3-bc1e-84cf45d04cde","Type":"ContainerStarted","Data":"74524914139f241c95d4fa9681bf55ebfa71cd049067e128a7cdef5aabd29bcd"}
Jul 07 18:44:13.040602 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.040576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlcv4" event={"ID":"f4963235-609b-4f16-9e27-4a4bfe6ea15a","Type":"ContainerStarted","Data":"a51c6ac68338216960bf984c5ccb21af04c58afddc4c09fcca8e2ea0440f3cbe"}
Jul 07 18:44:13.490890 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.490286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:13.490890 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.490496    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:13.490890 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.490559    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:15.490538921 +0000 UTC m=+6.044430392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.591344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.591402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.591568    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.591591    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.591604    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f8dzk for pod openshift-network-diagnostics/network-check-target-jk7kq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.591658    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk podName:ad5b68c5-5cd2-4c61-a3db-cd1681007742 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:15.591639866 +0000 UTC m=+6.145531334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8dzk" (UniqueName: "kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk") pod "network-check-target-jk7kq" (UID: "ad5b68c5-5cd2-4c61-a3db-cd1681007742") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.592046    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:13.592132 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.592095    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret podName:64f1ff43-b922-41c3-9e78-59920705e8c3 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:15.592080633 +0000 UTC m=+6.145972103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret") pod "global-pull-secret-syncer-8jg9g" (UID: "64f1ff43-b922-41c3-9e78-59920705e8c3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:13.915185 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.915060    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:39:11 +0000 UTC" deadline="2028-03-20 02:59:03.58870733 +0000 UTC"
Jul 07 18:44:13.915185 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.915097    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14912h14m49.673614505s"
Jul 07 18:44:13.945064 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.944015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:13.945064 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.944142    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:13.945064 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.944656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:13.945064 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.944768    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:13.945064 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:13.944840    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:13.945064 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:13.944919    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:15.505980 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:15.505943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:15.506592 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.506103    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:15.506592 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.506165    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:19.506147447 +0000 UTC m=+10.060038925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:15.606317 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:15.606280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:15.606501 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:15.606335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:15.606501 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.606444    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:15.606501 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.606459    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:15.606501 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.606472    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:15.606501 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.606483    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f8dzk for pod openshift-network-diagnostics/network-check-target-jk7kq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:15.606735 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.606510    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret podName:64f1ff43-b922-41c3-9e78-59920705e8c3 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:19.606492065 +0000 UTC m=+10.160383544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret") pod "global-pull-secret-syncer-8jg9g" (UID: "64f1ff43-b922-41c3-9e78-59920705e8c3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:15.606735 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.606527    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk podName:ad5b68c5-5cd2-4c61-a3db-cd1681007742 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:19.606518685 +0000 UTC m=+10.160410155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8dzk" (UniqueName: "kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk") pod "network-check-target-jk7kq" (UID: "ad5b68c5-5cd2-4c61-a3db-cd1681007742") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:15.942667 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:15.941490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:15.942667 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:15.941527    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:15.942667 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.941607    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:15.942667 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:15.941490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:15.942667 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.941752    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:15.942667 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:15.941841    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:17.941917 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:17.940558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:17.941917 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:17.940581    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:17.941917 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:17.940682    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:17.941917 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:17.940707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:17.941917 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:17.940795    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:17.941917 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:17.940884    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:19.538297 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:19.538169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:19.538733 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.538373    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:19.538733 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.538455    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:27.538432058 +0000 UTC m=+18.092323550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:19.638706 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:19.638669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:19.638897 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:19.638734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:19.638897 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.638887    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:19.639024 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.638900    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:19.639024 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.638913    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:19.639024 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.638926    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f8dzk for pod openshift-network-diagnostics/network-check-target-jk7kq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:19.639024 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.638970    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret podName:64f1ff43-b922-41c3-9e78-59920705e8c3 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:27.638952884 +0000 UTC m=+18.192844363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret") pod "global-pull-secret-syncer-8jg9g" (UID: "64f1ff43-b922-41c3-9e78-59920705e8c3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:19.639024 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.638990    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk podName:ad5b68c5-5cd2-4c61-a3db-cd1681007742 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:27.63898028 +0000 UTC m=+18.192871747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8dzk" (UniqueName: "kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk") pod "network-check-target-jk7kq" (UID: "ad5b68c5-5cd2-4c61-a3db-cd1681007742") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:19.941866 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:19.941777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:19.942012 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.941896    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:19.942012 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:19.941938    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:19.942120 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:19.941948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:19.942120 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.942045    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:19.942120 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:19.942100    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:21.941611 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:21.941097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:21.941611 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:21.941102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:21.941611 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:21.941227    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:21.941611 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:21.941383    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:21.941611 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:21.941102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:21.941611 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:21.941495    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:23.941539 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:23.941494    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:23.941539 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:23.941524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:23.941539 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:23.941533    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:23.942041 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:23.941654    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:23.942041 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:23.941767    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:23.942041 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:23.941855    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:25.941500 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:25.941461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:25.941900 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:25.941571    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:25.941900 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:25.941461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:25.941900 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:25.941611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:25.941900 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:25.941700    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:25.941900 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:25.941767    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:27.600808 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:27.600586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:27.601287 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.600740    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:27.601287 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.600933    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:43.600910838 +0000 UTC m=+34.154802305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:27.701740 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:27.701697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:27.701902 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:27.701752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:27.701902 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.701849    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:27.701902 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.701870    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:27.701902 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.701886    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:27.701902 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.701899    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f8dzk for pod openshift-network-diagnostics/network-check-target-jk7kq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:27.702076 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.701916    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret podName:64f1ff43-b922-41c3-9e78-59920705e8c3 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:43.70189786 +0000 UTC m=+34.255789338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret") pod "global-pull-secret-syncer-8jg9g" (UID: "64f1ff43-b922-41c3-9e78-59920705e8c3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:27.702076 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.701934    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk podName:ad5b68c5-5cd2-4c61-a3db-cd1681007742 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:43.701921939 +0000 UTC m=+34.255813417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8dzk" (UniqueName: "kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk") pod "network-check-target-jk7kq" (UID: "ad5b68c5-5cd2-4c61-a3db-cd1681007742") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:27.941405 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:27.941325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:27.941547 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:27.941325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:27.941547 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.941445    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:27.941547 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.941534    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:27.941687 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:27.941329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:27.941687 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:27.941651    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:29.942262 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:29.942208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:29.942696 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:29.942342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:29.942696 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:29.942347    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:29.942696 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:29.942385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:29.942696 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:29.942479    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:29.942696 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:29.942580    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:31.940506 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:31.940473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:31.940919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:31.940473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:31.940919 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:31.940580    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:31.940919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:31.940621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:31.940919 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:31.940619    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:31.940919 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:31.940706    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:32.111219 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:32.111182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"c67a27cad2eea6507d4961b6d52faa3b0ab300583849f3923d8954ca9e40d6e4"}
Jul 07 18:44:32.116401 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:32.116358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2d52" event={"ID":"e6d0c729-f21f-4cab-8ac7-e3308ce26c7d","Type":"ContainerStarted","Data":"d7c4c76935e71be896ffc73245dcc42731ba1924eaa7fd0e7889ed92d0c30020"}
Jul 07 18:44:32.119061 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:32.118857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hwwnl" event={"ID":"63474689-bf86-4dd1-8f0d-c50096f6e1b5","Type":"ContainerStarted","Data":"78b0942bc9cd200df411186a9078696384c605e42cb6c82bd0b30da4f8e14ead"}
Jul 07 18:44:32.120792 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:32.120738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" event={"ID":"2d21a0c9a3a458b1cdd0669a4a363f26","Type":"ContainerStarted","Data":"4dd28c95e28da73ebf9d86cc189050465a13e0d6230643deacacd118adc05eee"}
Jul 07 18:44:32.137047 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:32.137000    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l2d52" podStartSLOduration=2.800700758 podStartE2EDuration="22.136985664s" totalImagesPullingTime="19.336284906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:32.136585455 +0000 UTC m=+22.690476940" watchObservedRunningTime="2026-07-07 18:44:32.136985664 +0000 UTC m=+22.690877149"
Jul 07 18:44:32.181267 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:32.181203    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-133.ec2.internal" podStartSLOduration=21.181181902 podStartE2EDuration="21.181181902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:32.16009851 +0000 UTC m=+22.713989995" watchObservedRunningTime="2026-07-07 18:44:32.181181902 +0000 UTC m=+22.735073388"
Jul 07 18:44:33.124479 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.124241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlcv4" event={"ID":"f4963235-609b-4f16-9e27-4a4bfe6ea15a","Type":"ContainerStarted","Data":"68bb8fa1cf90ff88bb1d93aed46e641249995475cadc9b48eabaa51ee3aea286"}
Jul 07 18:44:33.125639 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.125620    2581 generic.go:356] "Generic (PLEG): container finished" podID="bc75046a7b2ae9a84906f50fc76e9a1e" containerID="0da60eb17b55207dd55d5f7a1b027f6cc31765e9aa331112957f4134cdb356d4" exitCode=0
Jul 07 18:44:33.125690 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.125680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" event={"ID":"bc75046a7b2ae9a84906f50fc76e9a1e","Type":"ContainerDied","Data":"0da60eb17b55207dd55d5f7a1b027f6cc31765e9aa331112957f4134cdb356d4"}
Jul 07 18:44:33.127142 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.127119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gsg6k" event={"ID":"c9f88930-6f75-42bc-afcb-fa26a9ebde8e","Type":"ContainerStarted","Data":"743c22336628dda1c0989d20bf74e7bc2b1105cdeec72ee4a72d7e573c319683"}
Jul 07 18:44:33.132011 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.131985    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"3465c7002f8a82130f51a1beabfdd76d359aab4396a609f1105bca71a62a26b4"}
Jul 07 18:44:33.132113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.132074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"93746c5fac640c78b1dd6ef38036b4cdc178f72fb3bdc4e5bc598e9f6a416913"}
Jul 07 18:44:33.132113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.132111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"a48cdfdec833875dd69628f0c462f30b692e3bcb77abe0a913b9da1eb2928f43"}
Jul 07 18:44:33.132297 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.132138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"631e8a15559ef664b1c2a22d8580e0a3b7b8f4e6bd2f8b2f3cff3322c3ffd72b"}
Jul 07 18:44:33.132297 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.132173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"4859eacbee04a75c587f03641b8bb9406ae9136d855aa25cdddf7f6f4cd6542a"}
Jul 07 18:44:33.133380 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.133359    2581 generic.go:356] "Generic (PLEG): container finished" podID="34b25510-f746-421c-8b6c-e848f2cd64c3" containerID="3fa27db77052bdec56115c70ad340b4ac8fd091f1f3075014231124413cae6bd" exitCode=0
Jul 07 18:44:33.133466 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.133433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerDied","Data":"3fa27db77052bdec56115c70ad340b4ac8fd091f1f3075014231124413cae6bd"}
Jul 07 18:44:33.134760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.134743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92" event={"ID":"5c1cf8a9-254d-4259-a332-cc239e20633d","Type":"ContainerStarted","Data":"f1178b597a938ad39c05837dbc349ecb2c7cc941a957974b80fd7279e2c2d2ae"}
Jul 07 18:44:33.136147 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.136109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wqprq" event={"ID":"fed1af96-65a9-4104-aacc-e681726d1a6b","Type":"ContainerStarted","Data":"e4fc99c7869c6e860a53c6c59441367351264505386bfc76b96fa3ae684309b3"}
Jul 07 18:44:33.137469 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.137448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tpnd4" event={"ID":"61183db6-1671-43b3-bc1e-84cf45d04cde","Type":"ContainerStarted","Data":"5079bfe8dfaa5186a51291f027ebc129985164388562822bd4c0175999f9ec3b"}
Jul 07 18:44:33.147803 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.147765    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hwwnl" podStartSLOduration=3.783603608 podStartE2EDuration="23.147753503s" totalImagesPullingTime="19.364149895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:32.18700716 +0000 UTC m=+22.740898646" watchObservedRunningTime="2026-07-07 18:44:33.147753503 +0000 UTC m=+23.701644989"
Jul 07 18:44:33.173537 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.173488    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dlcv4" podStartSLOduration=12.47537234 podStartE2EDuration="23.173466057s" totalImagesPullingTime="10.698093717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:33.147754467 +0000 UTC m=+23.701645954" watchObservedRunningTime="2026-07-07 18:44:33.173466057 +0000 UTC m=+23.727357545"
Jul 07 18:44:33.191526 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.191485    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gsg6k" podStartSLOduration=3.862015881 podStartE2EDuration="23.191471776s" totalImagesPullingTime="19.329455895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:33.190988861 +0000 UTC m=+23.744880347" watchObservedRunningTime="2026-07-07 18:44:33.191471776 +0000 UTC m=+23.745363261"
Jul 07 18:44:33.210194 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.210143    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wqprq" podStartSLOduration=4.234900042 podStartE2EDuration="23.210124144s" totalImagesPullingTime="18.975224102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:33.210068158 +0000 UTC m=+23.763959663" watchObservedRunningTime="2026-07-07 18:44:33.210124144 +0000 UTC m=+23.764015629"
Jul 07 18:44:33.247451 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.247401    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tpnd4" podStartSLOduration=12.55201415 podStartE2EDuration="23.247379659s" totalImagesPullingTime="10.695365509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:33.247061599 +0000 UTC m=+23.800953086" watchObservedRunningTime="2026-07-07 18:44:33.247379659 +0000 UTC m=+23.801271143"
Jul 07 18:44:33.941019 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.940985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:33.941019 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.940999    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:33.941210 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:33.941121    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:33.941210 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.941135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:33.941339 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:33.941267    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:33.941415 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:33.941384    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:33.990446 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:33.990414    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 18:44:34.141606 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:34.141519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" event={"ID":"bc75046a7b2ae9a84906f50fc76e9a1e","Type":"ContainerStarted","Data":"e4e56449034657fdd7dbe981c93caa03c826226b396512414cf8cab8ef8907b7"}
Jul 07 18:44:34.143435 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:34.143397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92" event={"ID":"5c1cf8a9-254d-4259-a332-cc239e20633d","Type":"ContainerStarted","Data":"ed939c226f8bf91a3155d360b6cbda1a6d0850438c4c67b73c9abeba4ca70d74"}
Jul 07 18:44:34.157910 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:34.157862    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-133.ec2.internal" podStartSLOduration=23.157839649 podStartE2EDuration="23.157839649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:34.15727339 +0000 UTC m=+24.711164875" watchObservedRunningTime="2026-07-07 18:44:34.157839649 +0000 UTC m=+24.711731134"
Jul 07 18:44:34.161473 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:34.161387    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:44:33.990431434Z","UUID":"47b0dfa5-dde4-4f16-b177-3b28e0e7a576","Handler":null,"Name":"","Endpoint":""}
Jul 07 18:44:34.162980 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:34.162961    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 18:44:34.163089 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:34.162995    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 18:44:35.149479 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:35.149433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"827e62ebe01fe98449960ab59c143a53d479ce9f039a210c710fd1fcf9212e03"}
Jul 07 18:44:35.940633 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:35.940602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:35.940633 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:35.940621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:35.940889 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:35.940602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:35.940889 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:35.940725    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:35.940889 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:35.940788    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:35.941043 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:35.940884    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:36.153092 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:36.153060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92" event={"ID":"5c1cf8a9-254d-4259-a332-cc239e20633d","Type":"ContainerStarted","Data":"c10830f9db354942b03833b23b845b6a886920b4b89d763345ceb20f14a1225f"}
Jul 07 18:44:36.174336 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:36.174289    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tw92" podStartSLOduration=4.36785656 podStartE2EDuration="26.174239846s" totalImagesPullingTime="21.806383286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:36.174014041 +0000 UTC m=+26.727905528" watchObservedRunningTime="2026-07-07 18:44:36.174239846 +0000 UTC m=+26.728131334"
Jul 07 18:44:37.048731 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.048564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:37.049046 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.049028    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:37.159763 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.159718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" event={"ID":"55f6885e-3922-4075-8d28-3ef4439500dc","Type":"ContainerStarted","Data":"283a0998114477ec133de4ffc9fcb1396412d93b9516647066f403bf324a9976"}
Jul 07 18:44:37.160425 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.160274    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:37.160522 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.160508    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tpnd4"
Jul 07 18:44:37.190731 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.189858    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8" podStartSLOduration=7.412674991 podStartE2EDuration="27.189837794s" totalImagesPullingTime="19.777162803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:37.18832544 +0000 UTC m=+27.742216928" watchObservedRunningTime="2026-07-07 18:44:37.189837794 +0000 UTC m=+27.743729281"
Jul 07 18:44:37.940902 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.940869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:37.941081 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.940883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:37.941081 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:37.940973    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:37.941195 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:37.940884    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:37.941195 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:37.941098    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:37.941195 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:37.941182    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:38.165143 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:38.164988    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:38.165143 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:38.165075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:38.165143 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:38.165126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:38.183240 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:38.183209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:38.183670 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:38.183651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:44:39.263392 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:39.263347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8jg9g"]
Jul 07 18:44:39.263952 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:39.263464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:39.263952 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:39.263577    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:39.266720 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:39.266656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2gm48"]
Jul 07 18:44:39.266882 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:39.266752    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:39.266882 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:39.266849    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:39.267483 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:39.267446    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jk7kq"]
Jul 07 18:44:39.267593 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:39.267532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:39.267651 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:39.267614    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:40.168889 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:40.168612    2581 generic.go:356] "Generic (PLEG): container finished" podID="34b25510-f746-421c-8b6c-e848f2cd64c3" containerID="0beb7dfedf961b3e8c2600224b507c4125d0b810b837111a0ddbf4e41d481fd5" exitCode=0
Jul 07 18:44:40.168889 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:40.168697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerDied","Data":"0beb7dfedf961b3e8c2600224b507c4125d0b810b837111a0ddbf4e41d481fd5"}
Jul 07 18:44:40.941130 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:40.940493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:40.941130 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:40.940601    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:40.941130 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:40.940918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:40.941130 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:40.940989    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:40.941130 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:40.941036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:40.941130 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:40.941088    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:41.173190 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:41.173067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerStarted","Data":"023ec2e6c252ab90ed33a0f31222533c59c5c71314eb69710c3c35ebdd06e799"}
Jul 07 18:44:42.177146 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:42.177116    2581 generic.go:356] "Generic (PLEG): container finished" podID="34b25510-f746-421c-8b6c-e848f2cd64c3" containerID="023ec2e6c252ab90ed33a0f31222533c59c5c71314eb69710c3c35ebdd06e799" exitCode=0
Jul 07 18:44:42.177537 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:42.177171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerDied","Data":"023ec2e6c252ab90ed33a0f31222533c59c5c71314eb69710c3c35ebdd06e799"}
Jul 07 18:44:42.941323 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:42.941296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:42.941437 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:42.941336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:42.941437 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:42.941336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:42.941437 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:42.941424    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:44:42.941596 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:42.941493    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk7kq" podUID="ad5b68c5-5cd2-4c61-a3db-cd1681007742"
Jul 07 18:44:42.941596 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:42.941569    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jg9g" podUID="64f1ff43-b922-41c3-9e78-59920705e8c3"
Jul 07 18:44:43.182113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:43.182048    2581 generic.go:356] "Generic (PLEG): container finished" podID="34b25510-f746-421c-8b6c-e848f2cd64c3" containerID="767ed6ef7de128a9c39c8695e93486a4dd6091df6278e2b62c0954b0a589df3f" exitCode=0
Jul 07 18:44:43.182113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:43.182089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerDied","Data":"767ed6ef7de128a9c39c8695e93486a4dd6091df6278e2b62c0954b0a589df3f"}
Jul 07 18:44:43.622968 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:43.622799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:43.623122 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.622945    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:43.623122 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.623031    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:15.623017277 +0000 UTC m=+66.176908742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:43.723371 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:43.723340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:43.723539 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:43.723420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:43.723539 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.723509    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:43.723539 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.723526    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:43.723668 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.723555    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:43.723668 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.723569    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f8dzk for pod openshift-network-diagnostics/network-check-target-jk7kq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:43.723668 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.723569    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret podName:64f1ff43-b922-41c3-9e78-59920705e8c3 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:15.723551247 +0000 UTC m=+66.277442734 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret") pod "global-pull-secret-syncer-8jg9g" (UID: "64f1ff43-b922-41c3-9e78-59920705e8c3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:43.723668 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:43.723628    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk podName:ad5b68c5-5cd2-4c61-a3db-cd1681007742 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:15.723612322 +0000 UTC m=+66.277503803 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8dzk" (UniqueName: "kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk") pod "network-check-target-jk7kq" (UID: "ad5b68c5-5cd2-4c61-a3db-cd1681007742") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:44.770681 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.770650    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-133.ec2.internal" event="NodeReady"
Jul 07 18:44:44.771120 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.770784    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 18:44:44.808910 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.808882    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"]
Jul 07 18:44:44.811751 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.811729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:44.812564 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.812243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cb84485c9-lsk7t"]
Jul 07 18:44:44.814451 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.814430    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 18:44:44.814561 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.814433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 18:44:44.814561 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.814521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 18:44:44.814561 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.814539    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 18:44:44.814722 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.814713    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 18:44:44.814930 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.814913    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"]
Jul 07 18:44:44.815056 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.815038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.815263 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.815233    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 18:44:44.815577 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.815555    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 18:44:44.817802 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.817729    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"]
Jul 07 18:44:44.817802 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.817809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:44.818071 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.817730    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 18:44:44.818275 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.818176    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 18:44:44.818275 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.818197    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9jbkl\""
Jul 07 18:44:44.818455 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.818433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 18:44:44.820534 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.820514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:44.820713 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.820692    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 18:44:44.822901 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.822726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 18:44:44.822901 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.822893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zs96t\""
Jul 07 18:44:44.824855 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.824832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"]
Jul 07 18:44:44.824938 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.824877    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 18:44:44.826318 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.826301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"]
Jul 07 18:44:44.826605 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.826587    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"]
Jul 07 18:44:44.828117 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.828102    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb84485c9-lsk7t"]
Jul 07 18:44:44.831086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.830724    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xn8wb"]
Jul 07 18:44:44.834271 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.834238    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cfrdl"]
Jul 07 18:44:44.834371 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.834352    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:44.837198 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.837177    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 18:44:44.837372 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.837352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 18:44:44.837435 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.837190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:44.838150 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.837795    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 18:44:44.838150 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.838086    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w2mm7\""
Jul 07 18:44:44.841224 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.840497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgd5v\""
Jul 07 18:44:44.841761 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.841739    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 18:44:44.841981 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.841963    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 18:44:44.845180 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.845157    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xn8wb"]
Jul 07 18:44:44.849513 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.849491    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfrdl"]
Jul 07 18:44:44.930403 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfk2\" (UniqueName: \"kubernetes.io/projected/56827528-2561-4873-b563-ea3923a472c6-kube-api-access-ckfk2\") pod \"managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf\" (UID: \"56827528-2561-4873-b563-ea3923a472c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:44.930524 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88b94b6a-9327-4e28-be7d-6a3f170658c6-config-volume\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:44.930524 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-klusterlet-config\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:44.930677 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-ca\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:44.930677 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:44.930677 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85b9c528-b2ca-4546-af82-16e893694e55-cert\") pod \"ingress-canary-xn8wb\" (UID: \"85b9c528-b2ca-4546-af82-16e893694e55\") " pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:44.930677 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jhj\" (UniqueName: \"kubernetes.io/projected/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-kube-api-access-d6jhj\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-image-registry-private-configuration\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rph4\" (UniqueName: \"kubernetes.io/projected/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-kube-api-access-8rph4\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsm2n\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-kube-api-access-zsm2n\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txp85\" (UniqueName: \"kubernetes.io/projected/88b94b6a-9327-4e28-be7d-6a3f170658c6-kube-api-access-txp85\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-installation-pull-secrets\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.930887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b94b6a-9327-4e28-be7d-6a3f170658c6-tmp-dir\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-certificates\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-tmp\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.930977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxc7\" (UniqueName: \"kubernetes.io/projected/85b9c528-b2ca-4546-af82-16e893694e55-kube-api-access-9dxc7\") pod \"ingress-canary-xn8wb\" (UID: \"85b9c528-b2ca-4546-af82-16e893694e55\") " pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.931038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.931069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a847a161-5cd4-4f47-92a7-b63e7bf2c559-ca-trust-extracted\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.931094    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-trusted-ca\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.931121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-bound-sa-token\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.931145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56827528-2561-4873-b563-ea3923a472c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf\" (UID: \"56827528-2561-4873-b563-ea3923a472c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:44.931311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.931167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-hub\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:44.940817 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.940790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:44:44.940924 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.940874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:44:44.941093 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.941076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:44:44.943915 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.943825    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:44:44.944013 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.943962    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:44:44.944129 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.944110    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:44:44.944752 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.944594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:44:44.944883 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.944815    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdqwt\""
Jul 07 18:44:44.945035 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:44.945020    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gxh7\""
Jul 07 18:44:45.032262 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jhj\" (UniqueName: \"kubernetes.io/projected/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-kube-api-access-d6jhj\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.032262 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-image-registry-private-configuration\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.032465 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.032465 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rph4\" (UniqueName: \"kubernetes.io/projected/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-kube-api-access-8rph4\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:45.032465 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.032465 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsm2n\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-kube-api-access-zsm2n\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.032465 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.032465 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txp85\" (UniqueName: \"kubernetes.io/projected/88b94b6a-9327-4e28-be7d-6a3f170658c6-kube-api-access-txp85\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.032475    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-installation-pull-secrets\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.032547    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:45.532522587 +0000 UTC m=+36.086414058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b94b6a-9327-4e28-be7d-6a3f170658c6-tmp-dir\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-certificates\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-tmp\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxc7\" (UniqueName: \"kubernetes.io/projected/85b9c528-b2ca-4546-af82-16e893694e55-kube-api-access-9dxc7\") pod \"ingress-canary-xn8wb\" (UID: \"85b9c528-b2ca-4546-af82-16e893694e55\") " pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:45.032760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a847a161-5cd4-4f47-92a7-b63e7bf2c559-ca-trust-extracted\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-trusted-ca\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-bound-sa-token\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56827528-2561-4873-b563-ea3923a472c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf\" (UID: \"56827528-2561-4873-b563-ea3923a472c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-hub\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfk2\" (UniqueName: \"kubernetes.io/projected/56827528-2561-4873-b563-ea3923a472c6-kube-api-access-ckfk2\") pod \"managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf\" (UID: \"56827528-2561-4873-b563-ea3923a472c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88b94b6a-9327-4e28-be7d-6a3f170658c6-config-volume\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032945    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b94b6a-9327-4e28-be7d-6a3f170658c6-tmp-dir\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.032992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-klusterlet-config\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.033026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-ca\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.033042    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-tmp\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.033053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.033174 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.033088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85b9c528-b2ca-4546-af82-16e893694e55-cert\") pod \"ingress-canary-xn8wb\" (UID: \"85b9c528-b2ca-4546-af82-16e893694e55\") " pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:45.033796 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.033145    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.033796 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.033242    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:44:45.033796 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.033296    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:44:45.033796 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.033342    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:45.533327853 +0000 UTC m=+36.087219358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:44:45.033796 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.033615    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a847a161-5cd4-4f47-92a7-b63e7bf2c559-ca-trust-extracted\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.033796 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.033679    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-certificates\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.034126 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.034106    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88b94b6a-9327-4e28-be7d-6a3f170658c6-config-volume\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.034532 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.034483    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-trusted-ca\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.037458 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.037414    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-ca\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.037458 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.037416    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-image-registry-private-configuration\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.037629 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.037459    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-installation-pull-secrets\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.037731 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.037711    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56827528-2561-4873-b563-ea3923a472c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf\" (UID: \"56827528-2561-4873-b563-ea3923a472c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:45.037884 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.037863    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-hub\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.038065 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.038045    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-klusterlet-config\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:45.038615 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.038599    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85b9c528-b2ca-4546-af82-16e893694e55-cert\") pod \"ingress-canary-xn8wb\" (UID: \"85b9c528-b2ca-4546-af82-16e893694e55\") " pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:45.038698 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.038680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.038992 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.038978    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.045021 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.044995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rph4\" (UniqueName: \"kubernetes.io/projected/5fd04a4d-abc6-46fd-9b6a-2218b14cb140-kube-api-access-8rph4\") pod \"klusterlet-addon-workmgr-76f98864f5-j4cjr\" (UID: \"5fd04a4d-abc6-46fd-9b6a-2218b14cb140\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:45.045543 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.045520    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsm2n\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-kube-api-access-zsm2n\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.046541 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.046507    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-bound-sa-token\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.047090 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.047069    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfk2\" (UniqueName: \"kubernetes.io/projected/56827528-2561-4873-b563-ea3923a472c6-kube-api-access-ckfk2\") pod \"managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf\" (UID: \"56827528-2561-4873-b563-ea3923a472c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:45.047178 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.047095    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxc7\" (UniqueName: \"kubernetes.io/projected/85b9c528-b2ca-4546-af82-16e893694e55-kube-api-access-9dxc7\") pod \"ingress-canary-xn8wb\" (UID: \"85b9c528-b2ca-4546-af82-16e893694e55\") " pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:45.047318 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.047300    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txp85\" (UniqueName: \"kubernetes.io/projected/88b94b6a-9327-4e28-be7d-6a3f170658c6-kube-api-access-txp85\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.048688 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.048669    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jhj\" (UniqueName: \"kubernetes.io/projected/ea26f0ba-e281-4b1d-a1a0-f85fd244c35b-kube-api-access-d6jhj\") pod \"cluster-proxy-proxy-agent-947c766bb-fz5fj\" (UID: \"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.135837 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.135813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:44:45.153092 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.153067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:45.161049 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.160971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"
Jul 07 18:44:45.175311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.175120    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xn8wb"
Jul 07 18:44:45.334817 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.334786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"]
Jul 07 18:44:45.340133 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:45.340103    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd04a4d_abc6_46fd_9b6a_2218b14cb140.slice/crio-f1f21bec0acb14a0b877eeb73c41763d12f4ff2fd0a6f4ba22c21a477c370dc0 WatchSource:0}: Error finding container f1f21bec0acb14a0b877eeb73c41763d12f4ff2fd0a6f4ba22c21a477c370dc0: Status 404 returned error can't find the container with id f1f21bec0acb14a0b877eeb73c41763d12f4ff2fd0a6f4ba22c21a477c370dc0
Jul 07 18:44:45.344088 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.344033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"]
Jul 07 18:44:45.348186 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.348164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf"]
Jul 07 18:44:45.359595 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:45.359573    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56827528_2561_4873_b563_ea3923a472c6.slice/crio-9317fa91e7c522460e750524bc6bb1b1e081ff4397f885891c1a7a26190034d5 WatchSource:0}: Error finding container 9317fa91e7c522460e750524bc6bb1b1e081ff4397f885891c1a7a26190034d5: Status 404 returned error can't find the container with id 9317fa91e7c522460e750524bc6bb1b1e081ff4397f885891c1a7a26190034d5
Jul 07 18:44:45.360160 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:45.360138    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea26f0ba_e281_4b1d_a1a0_f85fd244c35b.slice/crio-3d47f451aa2b0c2f967b982c82103722dc4a238874be2bb7919dea37a56c7581 WatchSource:0}: Error finding container 3d47f451aa2b0c2f967b982c82103722dc4a238874be2bb7919dea37a56c7581: Status 404 returned error can't find the container with id 3d47f451aa2b0c2f967b982c82103722dc4a238874be2bb7919dea37a56c7581
Jul 07 18:44:45.371322 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.371246    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xn8wb"]
Jul 07 18:44:45.373526 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:44:45.373493    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b9c528_b2ca_4546_af82_16e893694e55.slice/crio-98849c1ce82a96641c539438d112747747455a36372ab21e50d95bf75958dd36 WatchSource:0}: Error finding container 98849c1ce82a96641c539438d112747747455a36372ab21e50d95bf75958dd36: Status 404 returned error can't find the container with id 98849c1ce82a96641c539438d112747747455a36372ab21e50d95bf75958dd36
Jul 07 18:44:45.539869 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.539605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:45.539869 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.539759    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:44:45.540082 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.539874    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:44:45.540082 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:45.539894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:45.540082 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.539951    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:46.539923894 +0000 UTC m=+37.093815372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:44:45.540082 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.540013    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:44:45.540082 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:45.540069    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:46.540053536 +0000 UTC m=+37.093945014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:44:46.202459 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:46.202344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf" event={"ID":"56827528-2561-4873-b563-ea3923a472c6","Type":"ContainerStarted","Data":"9317fa91e7c522460e750524bc6bb1b1e081ff4397f885891c1a7a26190034d5"}
Jul 07 18:44:46.208237 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:46.204886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xn8wb" event={"ID":"85b9c528-b2ca-4546-af82-16e893694e55","Type":"ContainerStarted","Data":"98849c1ce82a96641c539438d112747747455a36372ab21e50d95bf75958dd36"}
Jul 07 18:44:46.208237 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:46.208075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" event={"ID":"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b","Type":"ContainerStarted","Data":"3d47f451aa2b0c2f967b982c82103722dc4a238874be2bb7919dea37a56c7581"}
Jul 07 18:44:46.210922 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:46.210886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr" event={"ID":"5fd04a4d-abc6-46fd-9b6a-2218b14cb140","Type":"ContainerStarted","Data":"f1f21bec0acb14a0b877eeb73c41763d12f4ff2fd0a6f4ba22c21a477c370dc0"}
Jul 07 18:44:46.549672 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:46.549632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:46.549876 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:46.549741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:46.549940 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:46.549919    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:44:46.549940 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:46.549935    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:44:46.550036 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:46.550004    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:48.54998591 +0000 UTC m=+39.103877380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:44:46.550652 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:46.550599    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:44:46.550652 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:46.550655    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:48.550638484 +0000 UTC m=+39.104529962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:44:48.574069 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:48.574028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:48.574573 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:48.574126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:48.574573 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:48.574279    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:44:48.574573 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:48.574345    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:52.574325701 +0000 UTC m=+43.128217171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:44:48.574751 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:48.574741    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:44:48.574803 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:48.574758    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:44:48.574803 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:48.574800    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:52.574784358 +0000 UTC m=+43.128675825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:44:52.610319 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:52.610273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:44:52.610773 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:52.610443    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:44:52.610773 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:52.610470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:44:52.610773 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:52.610510    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:00.610493772 +0000 UTC m=+51.164385236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:44:52.610773 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:52.610571    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:44:52.610773 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:52.610586    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:44:52.610773 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:44:52.610638    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:00.610622325 +0000 UTC m=+51.164513792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:44:56.242735 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.242701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xn8wb" event={"ID":"85b9c528-b2ca-4546-af82-16e893694e55","Type":"ContainerStarted","Data":"9f270545dc26e30398a7435e2e9d7fba3852ddf855c93075306cdc5b7694f38d"}
Jul 07 18:44:56.244687 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.244664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" event={"ID":"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b","Type":"ContainerStarted","Data":"577dd3ddf7e27543a919c688e0c4e0268baed8ee691c54aeabd648c3dffb45a6"}
Jul 07 18:44:56.244808 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.244695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" event={"ID":"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b","Type":"ContainerStarted","Data":"19eac5e8c7aa0ee0186f7076a3908e8554728e563b3e0421c644b17e770bbd11"}
Jul 07 18:44:56.244808 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.244707    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" event={"ID":"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b","Type":"ContainerStarted","Data":"acb25473fcb7f91f3b996196c3bff87bc190dda27e088300c994c1b26d249082"}
Jul 07 18:44:56.246070 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.246044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr" event={"ID":"5fd04a4d-abc6-46fd-9b6a-2218b14cb140","Type":"ContainerStarted","Data":"b7615f13aea2a795793471d12f40545ff0069296031315396ac25ef911057f4b"}
Jul 07 18:44:56.246236 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.246218    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:56.247627 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.247606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf" event={"ID":"56827528-2561-4873-b563-ea3923a472c6","Type":"ContainerStarted","Data":"5b479c2891f84e589a4335807848724f13f99809750969324071317beda74f21"}
Jul 07 18:44:56.248141 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.248120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:44:56.250150 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.250130    2581 generic.go:356] "Generic (PLEG): container finished" podID="34b25510-f746-421c-8b6c-e848f2cd64c3" containerID="a6816d0032f7515a07f645c7c28ec174ca6998de727ed42299021ec11c3485ed" exitCode=0
Jul 07 18:44:56.250213 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.250154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerDied","Data":"a6816d0032f7515a07f645c7c28ec174ca6998de727ed42299021ec11c3485ed"}
Jul 07 18:44:56.260977 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.260943    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xn8wb" podStartSLOduration=2.370960946 podStartE2EDuration="12.260932329s" totalImagesPullingTime="9.889971383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:56.260394194 +0000 UTC m=+46.814285696" watchObservedRunningTime="2026-07-07 18:44:56.260932329 +0000 UTC m=+46.814823793"
Jul 07 18:44:56.300790 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.300503    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf" podStartSLOduration=19.395402638 podStartE2EDuration="29.300481388s" totalImagesPullingTime="9.90507875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:56.299236763 +0000 UTC m=+46.853128252" watchObservedRunningTime="2026-07-07 18:44:56.300481388 +0000 UTC m=+46.854372872"
Jul 07 18:44:56.334551 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.329063    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" podStartSLOduration=19.424400495 podStartE2EDuration="29.32904143s" totalImagesPullingTime="9.904640935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:56.325657593 +0000 UTC m=+46.879549080" watchObservedRunningTime="2026-07-07 18:44:56.32904143 +0000 UTC m=+46.882932918"
Jul 07 18:44:56.351402 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:56.351357    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr" podStartSLOduration=19.412314464 podStartE2EDuration="29.35133796s" totalImagesPullingTime="9.939023496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:56.35046345 +0000 UTC m=+46.904354937" watchObservedRunningTime="2026-07-07 18:44:56.35133796 +0000 UTC m=+46.905229439"
Jul 07 18:44:57.255277 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:57.255234    2581 generic.go:356] "Generic (PLEG): container finished" podID="34b25510-f746-421c-8b6c-e848f2cd64c3" containerID="0b7c6d7bb2202ba04d1a7f360f54efc762c79349d1f703924f9ef7a518d69011" exitCode=0
Jul 07 18:44:57.255727 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:57.255333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerDied","Data":"0b7c6d7bb2202ba04d1a7f360f54efc762c79349d1f703924f9ef7a518d69011"}
Jul 07 18:44:58.261501 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:58.261464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-452fq" event={"ID":"34b25510-f746-421c-8b6c-e848f2cd64c3","Type":"ContainerStarted","Data":"32897229e3ac091f16f47837009d7d24e892c1fdc956cc100caabd64a018147a"}
Jul 07 18:44:58.285757 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:44:58.285703    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-452fq" podStartSLOduration=8.543013861 podStartE2EDuration="48.285687556s" totalImagesPullingTime="39.742673695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:58.28447836 +0000 UTC m=+48.838369858" watchObservedRunningTime="2026-07-07 18:44:58.285687556 +0000 UTC m=+48.839579041"
Jul 07 18:45:00.672337 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:00.672291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:45:00.672799 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:00.672451    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:45:00.672799 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:00.672474    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:45:00.672799 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:00.672458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:45:00.672799 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:00.672524    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:16.672509566 +0000 UTC m=+67.226401052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:45:00.672799 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:00.672549    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:00.672799 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:00.672623    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:16.672603153 +0000 UTC m=+67.226494618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:10.179373 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:10.179344    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkkk8"
Jul 07 18:45:15.687957 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.687917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:45:15.690771 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.690751    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:45:15.698853 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:15.698835    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 18:45:15.698902 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:15.698891    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:19.698876493 +0000 UTC m=+130.252767957 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : secret "metrics-daemon-secret" not found
Jul 07 18:45:15.788319 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.788286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:45:15.788447 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.788390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:45:15.790769 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.790749    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:45:15.790855 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.790835    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:45:15.800765 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.800742    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:45:15.801814 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.801795    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64f1ff43-b922-41c3-9e78-59920705e8c3-original-pull-secret\") pod \"global-pull-secret-syncer-8jg9g\" (UID: \"64f1ff43-b922-41c3-9e78-59920705e8c3\") " pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:45:15.811554 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.811529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8dzk\" (UniqueName: \"kubernetes.io/projected/ad5b68c5-5cd2-4c61-a3db-cd1681007742-kube-api-access-f8dzk\") pod \"network-check-target-jk7kq\" (UID: \"ad5b68c5-5cd2-4c61-a3db-cd1681007742\") " pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:45:15.855198 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.855177    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdqwt\""
Jul 07 18:45:15.859387 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.859373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jg9g"
Jul 07 18:45:15.863018 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.863003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:45:15.995312 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:15.995282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8jg9g"]
Jul 07 18:45:15.998282 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:45:15.998239    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f1ff43_b922_41c3_9e78_59920705e8c3.slice/crio-d67dbf5def77520bcd2a41b38e511ba21a23b838691c9d0fd2fa3009fed02cb2 WatchSource:0}: Error finding container d67dbf5def77520bcd2a41b38e511ba21a23b838691c9d0fd2fa3009fed02cb2: Status 404 returned error can't find the container with id d67dbf5def77520bcd2a41b38e511ba21a23b838691c9d0fd2fa3009fed02cb2
Jul 07 18:45:16.013229 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:16.013205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jk7kq"]
Jul 07 18:45:16.016902 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:45:16.016879    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5b68c5_5cd2_4c61_a3db_cd1681007742.slice/crio-2550ef3fba31306b0f73963fd7185c82abfe64271187241f33bed217dbdcb66e WatchSource:0}: Error finding container 2550ef3fba31306b0f73963fd7185c82abfe64271187241f33bed217dbdcb66e: Status 404 returned error can't find the container with id 2550ef3fba31306b0f73963fd7185c82abfe64271187241f33bed217dbdcb66e
Jul 07 18:45:16.318124 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:16.318085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jk7kq" event={"ID":"ad5b68c5-5cd2-4c61-a3db-cd1681007742","Type":"ContainerStarted","Data":"2550ef3fba31306b0f73963fd7185c82abfe64271187241f33bed217dbdcb66e"}
Jul 07 18:45:16.319082 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:16.319060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8jg9g" event={"ID":"64f1ff43-b922-41c3-9e78-59920705e8c3","Type":"ContainerStarted","Data":"d67dbf5def77520bcd2a41b38e511ba21a23b838691c9d0fd2fa3009fed02cb2"}
Jul 07 18:45:16.696310 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:16.696206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:45:16.696749 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:16.696309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:45:16.696749 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:16.696469    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:45:16.696749 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:16.696485    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:45:16.696749 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:16.696534    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:48.696516258 +0000 UTC m=+99.250407736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:45:16.696920 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:16.696903    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:16.696969 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:16.696962    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:48.696945494 +0000 UTC m=+99.250836981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:21.336903 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:21.336862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jk7kq" event={"ID":"ad5b68c5-5cd2-4c61-a3db-cd1681007742","Type":"ContainerStarted","Data":"9e6e256f8d67fbfd1f6f4a4b3705c11de0bdb3b0521a4e84637ca448e87e206c"}
Jul 07 18:45:21.337428 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:21.336987    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:45:21.338220 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:21.338197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8jg9g" event={"ID":"64f1ff43-b922-41c3-9e78-59920705e8c3","Type":"ContainerStarted","Data":"cfebd8e449e9e0e7fc8d3736f5c3c1bd2c2754c7320c9be358a64f0886d3778e"}
Jul 07 18:45:21.353975 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:21.353932    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jk7kq" podStartSLOduration=67.028662521 podStartE2EDuration="1m11.353918564s" totalImagesPullingTime="4.325256043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:45:21.353083823 +0000 UTC m=+71.906975309" watchObservedRunningTime="2026-07-07 18:45:21.353918564 +0000 UTC m=+71.907810073"
Jul 07 18:45:21.367877 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:21.367837    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8jg9g" podStartSLOduration=67.019117358 podStartE2EDuration="1m11.367823471s" totalImagesPullingTime="4.348706113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:45:21.367283576 +0000 UTC m=+71.921175063" watchObservedRunningTime="2026-07-07 18:45:21.367823471 +0000 UTC m=+71.921714957"
Jul 07 18:45:48.742276 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:48.742225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:45:48.742680 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:48.742306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:45:48.742680 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:48.742398    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:45:48.742680 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:48.742403    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:48.742680 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:48.742409    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb84485c9-lsk7t: secret "image-registry-tls" not found
Jul 07 18:45:48.742680 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:48.742505    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls podName:88b94b6a-9327-4e28-be7d-6a3f170658c6 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:52.742483005 +0000 UTC m=+163.296374487 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls") pod "dns-default-cfrdl" (UID: "88b94b6a-9327-4e28-be7d-6a3f170658c6") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:48.742680 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:45:48.742544    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls podName:a847a161-5cd4-4f47-92a7-b63e7bf2c559 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:52.742533018 +0000 UTC m=+163.296424498 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls") pod "image-registry-cb84485c9-lsk7t" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559") : secret "image-registry-tls" not found
Jul 07 18:45:52.344412 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:45:52.344376    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jk7kq"
Jul 07 18:46:07.957063 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.957037    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2ct7w"]
Jul 07 18:46:07.960037 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.960019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:07.962399 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.962370    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 18:46:07.962660 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.962644    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 18:46:07.963337 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.963322    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 18:46:07.963337 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.963333    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-htdwq\""
Jul 07 18:46:07.963505 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.963357    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 18:46:07.972551 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.972532    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ct7w"]
Jul 07 18:46:07.978304 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.978286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:07.978416 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.978328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blmtt\" (UniqueName: \"kubernetes.io/projected/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-api-access-blmtt\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:07.978480 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.978417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/564813d0-2b2d-438a-a44e-2aacd38ac151-crio-socket\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:07.978480 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.978465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:07.978555 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:07.978520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/564813d0-2b2d-438a-a44e-2aacd38ac151-data-volume\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.079789 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.079749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blmtt\" (UniqueName: \"kubernetes.io/projected/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-api-access-blmtt\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.079819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/564813d0-2b2d-438a-a44e-2aacd38ac151-crio-socket\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.079854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.079882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/564813d0-2b2d-438a-a44e-2aacd38ac151-data-volume\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.079926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.079947    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/564813d0-2b2d-438a-a44e-2aacd38ac151-crio-socket\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.079973    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.079997    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.080040 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.080038    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:08.580021691 +0000 UTC m=+119.133913172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:08.080367 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.080063    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:08.58004734 +0000 UTC m=+119.133938821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.080764 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.080748    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/564813d0-2b2d-438a-a44e-2aacd38ac151-data-volume\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.091139 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.091122    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blmtt\" (UniqueName: \"kubernetes.io/projected/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-api-access-blmtt\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.583377 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.583345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.583569 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:08.583426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:08.583569 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.583479    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.583569 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.583521    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:08.583569 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.583561    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:09.583543212 +0000 UTC m=+120.137434695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.583785 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:08.583580    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:09.58357091 +0000 UTC m=+120.137462377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:09.590541 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:09.590509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:09.590893 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:09.590565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:09.590893 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:09.590678    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:09.590893 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:09.590702    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:09.590893 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:09.590736    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:11.59072139 +0000 UTC m=+122.144612859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:09.590893 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:09.590765    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:11.590752874 +0000 UTC m=+122.144644338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:09.947391 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:09.947318    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlcv4_f4963235-609b-4f16-9e27-4a4bfe6ea15a/dns-node-resolver/0.log"
Jul 07 18:46:10.947322 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:10.947297    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wqprq_fed1af96-65a9-4104-aacc-e681726d1a6b/node-ca/0.log"
Jul 07 18:46:11.606468 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:11.606419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:11.606669 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:11.606484    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:11.606669 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:11.606562    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:11.606669 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:11.606572    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:11.606669 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:11.606614    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:15.606600509 +0000 UTC m=+126.160491973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:11.606669 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:11.606627    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:15.606621054 +0000 UTC m=+126.160512517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:11.747225 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:11.747200    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xn8wb_85b9c528-b2ca-4546-af82-16e893694e55/serve-healthcheck-canary/0.log"
Jul 07 18:46:15.636503 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:15.636464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:15.636859 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:15.636520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:15.636859 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:15.636604    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:15.636859 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:15.636615    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:15.636859 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:15.636667    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:23.636652233 +0000 UTC m=+134.190543702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:15.636859 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:15.636683    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:23.636676647 +0000 UTC m=+134.190568111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:19.766228 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:19.766193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:46:19.766602 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:19.766350    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 18:46:19.766602 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:19.766411    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs podName:9c2883e3-900b-479a-a926-33e779cf95b4 nodeName:}" failed. No retries permitted until 2026-07-07 18:48:21.766395802 +0000 UTC m=+252.320287266 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs") pod "network-metrics-daemon-2gm48" (UID: "9c2883e3-900b-479a-a926-33e779cf95b4") : secret "metrics-daemon-secret" not found
Jul 07 18:46:23.696275 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:23.696203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:23.696773 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:23.696299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:23.696773 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:23.696365    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:23.696773 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:23.696446    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls podName:564813d0-2b2d-438a-a44e-2aacd38ac151 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:39.696430338 +0000 UTC m=+150.250321818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ct7w" (UID: "564813d0-2b2d-438a-a44e-2aacd38ac151") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:23.696883 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:23.696818    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/564813d0-2b2d-438a-a44e-2aacd38ac151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:39.722539 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:39.722499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:39.724756 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:39.724736    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/564813d0-2b2d-438a-a44e-2aacd38ac151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ct7w\" (UID: \"564813d0-2b2d-438a-a44e-2aacd38ac151\") " pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:39.771597 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:39.771568    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-htdwq\""
Jul 07 18:46:39.779138 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:39.779120    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ct7w"
Jul 07 18:46:39.905605 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:39.905575    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ct7w"]
Jul 07 18:46:39.908940 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:46:39.908916    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564813d0_2b2d_438a_a44e_2aacd38ac151.slice/crio-320e5ffb110776156746e6064e77fae2161518cd26c91de4ae04e44da16df9bc WatchSource:0}: Error finding container 320e5ffb110776156746e6064e77fae2161518cd26c91de4ae04e44da16df9bc: Status 404 returned error can't find the container with id 320e5ffb110776156746e6064e77fae2161518cd26c91de4ae04e44da16df9bc
Jul 07 18:46:40.580756 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:40.580665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ct7w" event={"ID":"564813d0-2b2d-438a-a44e-2aacd38ac151","Type":"ContainerStarted","Data":"320e5ffb110776156746e6064e77fae2161518cd26c91de4ae04e44da16df9bc"}
Jul 07 18:46:44.595271 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:44.595221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ct7w" event={"ID":"564813d0-2b2d-438a-a44e-2aacd38ac151","Type":"ContainerStarted","Data":"5de1c865efdf7a17570c3cb26a8f53262c293fe373ca66c3700d84cdfea2a198"}
Jul 07 18:46:44.595619 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:44.595294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ct7w" event={"ID":"564813d0-2b2d-438a-a44e-2aacd38ac151","Type":"ContainerStarted","Data":"f143e1bc987d3e667b00399e6fe07a2a9dc5cd74241b518046793ba13757e694"}
Jul 07 18:46:47.607395 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:47.607364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ct7w" event={"ID":"564813d0-2b2d-438a-a44e-2aacd38ac151","Type":"ContainerStarted","Data":"f6ea511389434ce04fc6e035de2d19549a02fe7c1bf32e2840c05996a66386b3"}
Jul 07 18:46:47.637089 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:47.637043    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2ct7w" podStartSLOduration=33.702105558 podStartE2EDuration="40.63702921s" totalImagesPullingTime="6.934923652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:46:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:47.635808385 +0000 UTC m=+158.189699872" watchObservedRunningTime="2026-07-07 18:46:47.63702921 +0000 UTC m=+158.190920695"
Jul 07 18:46:47.847452 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:47.844348    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t" podUID="a847a161-5cd4-4f47-92a7-b63e7bf2c559"
Jul 07 18:46:47.880846 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:47.880772    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cfrdl" podUID="88b94b6a-9327-4e28-be7d-6a3f170658c6"
Jul 07 18:46:47.965819 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:46:47.965786    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2gm48" podUID="9c2883e3-900b-479a-a926-33e779cf95b4"
Jul 07 18:46:48.609913 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:48.609881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:46:48.610291 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:48.610007    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:46:52.828500 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:52.828463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:46:52.828873 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:52.828517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:46:52.830762 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:52.830731    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88b94b6a-9327-4e28-be7d-6a3f170658c6-metrics-tls\") pod \"dns-default-cfrdl\" (UID: \"88b94b6a-9327-4e28-be7d-6a3f170658c6\") " pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:46:52.830868 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:52.830825    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"image-registry-cb84485c9-lsk7t\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") " pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:46:53.113777 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.113695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgd5v\""
Jul 07 18:46:53.113943 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.113709    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9jbkl\""
Jul 07 18:46:53.120670 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.120649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:46:53.120763 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.120732    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:46:53.255779 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.255749    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb84485c9-lsk7t"]
Jul 07 18:46:53.258712 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:46:53.258681    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda847a161_5cd4_4f47_92a7_b63e7bf2c559.slice/crio-a1c69912533f9d470ea0fdcf6bca5e9ddac239c070b613b9c48df775f8eed979 WatchSource:0}: Error finding container a1c69912533f9d470ea0fdcf6bca5e9ddac239c070b613b9c48df775f8eed979: Status 404 returned error can't find the container with id a1c69912533f9d470ea0fdcf6bca5e9ddac239c070b613b9c48df775f8eed979
Jul 07 18:46:53.268677 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.268654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfrdl"]
Jul 07 18:46:53.271821 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:46:53.271796    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b94b6a_9327_4e28_be7d_6a3f170658c6.slice/crio-040917416d5209a519a26b05a411af5b8a2f540431e65ec12692dfc04d5b7e10 WatchSource:0}: Error finding container 040917416d5209a519a26b05a411af5b8a2f540431e65ec12692dfc04d5b7e10: Status 404 returned error can't find the container with id 040917416d5209a519a26b05a411af5b8a2f540431e65ec12692dfc04d5b7e10
Jul 07 18:46:53.624808 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.624771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t" event={"ID":"a847a161-5cd4-4f47-92a7-b63e7bf2c559","Type":"ContainerStarted","Data":"ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319"}
Jul 07 18:46:53.624990 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.624839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t" event={"ID":"a847a161-5cd4-4f47-92a7-b63e7bf2c559","Type":"ContainerStarted","Data":"a1c69912533f9d470ea0fdcf6bca5e9ddac239c070b613b9c48df775f8eed979"}
Jul 07 18:46:53.624990 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.624874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:46:53.625872 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.625843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfrdl" event={"ID":"88b94b6a-9327-4e28-be7d-6a3f170658c6","Type":"ContainerStarted","Data":"040917416d5209a519a26b05a411af5b8a2f540431e65ec12692dfc04d5b7e10"}
Jul 07 18:46:53.649729 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:53.649676    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t" podStartSLOduration=163.649659498 podStartE2EDuration="2m43.649659498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:53.649590412 +0000 UTC m=+164.203481900" watchObservedRunningTime="2026-07-07 18:46:53.649659498 +0000 UTC m=+164.203550986"
Jul 07 18:46:54.554517 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.554482    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k4zq2"]
Jul 07 18:46:54.557450 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.557435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.559757 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.559731    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 18:46:54.560683 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.560657    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 18:46:54.560770 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.560704    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 18:46:54.560770 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.560712    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t5r4f\""
Jul 07 18:46:54.560883 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.560706    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 18:46:54.560883 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.560658    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 18:46:54.560883 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.560658    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 18:46:54.645266 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-wtmp\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645421 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645421 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-textfile\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645421 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-sys\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645421 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-root\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645421 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-tls\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645624 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645624 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kt65\" (UniqueName: \"kubernetes.io/projected/02d22937-c23e-4a61-8477-db6e10e41ee6-kube-api-access-8kt65\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.645624 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.645514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d22937-c23e-4a61-8477-db6e10e41ee6-metrics-client-ca\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.746851 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.746813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-textfile\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747021 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.746864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-sys\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747021 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.746904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-root\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747021 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.746954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-tls\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747021 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-sys\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kt65\" (UniqueName: \"kubernetes.io/projected/02d22937-c23e-4a61-8477-db6e10e41ee6-kube-api-access-8kt65\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d22937-c23e-4a61-8477-db6e10e41ee6-metrics-client-ca\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747157    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-textfile\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747162    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-root\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-wtmp\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747566 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747464    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-wtmp\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747674 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747623    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d22937-c23e-4a61-8477-db6e10e41ee6-metrics-client-ca\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.747779 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.747753    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.749987 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.749959    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-tls\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.750092 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.750058    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02d22937-c23e-4a61-8477-db6e10e41ee6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.755355 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.755313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kt65\" (UniqueName: \"kubernetes.io/projected/02d22937-c23e-4a61-8477-db6e10e41ee6-kube-api-access-8kt65\") pod \"node-exporter-k4zq2\" (UID: \"02d22937-c23e-4a61-8477-db6e10e41ee6\") " pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:54.867196 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:54.867109    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k4zq2"
Jul 07 18:46:55.105508 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:46:55.105466    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d22937_c23e_4a61_8477_db6e10e41ee6.slice/crio-a8db911e711f989d1345322c8db1356a794435d19ac4d028562ea988dd90fcc4 WatchSource:0}: Error finding container a8db911e711f989d1345322c8db1356a794435d19ac4d028562ea988dd90fcc4: Status 404 returned error can't find the container with id a8db911e711f989d1345322c8db1356a794435d19ac4d028562ea988dd90fcc4
Jul 07 18:46:55.635388 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.635351    2581 generic.go:356] "Generic (PLEG): container finished" podID="56827528-2561-4873-b563-ea3923a472c6" containerID="5b479c2891f84e589a4335807848724f13f99809750969324071317beda74f21" exitCode=255
Jul 07 18:46:55.635804 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.635428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf" event={"ID":"56827528-2561-4873-b563-ea3923a472c6","Type":"ContainerDied","Data":"5b479c2891f84e589a4335807848724f13f99809750969324071317beda74f21"}
Jul 07 18:46:55.635804 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.635796    2581 scope.go:117] "RemoveContainer" containerID="5b479c2891f84e589a4335807848724f13f99809750969324071317beda74f21"
Jul 07 18:46:55.636905 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.636880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4zq2" event={"ID":"02d22937-c23e-4a61-8477-db6e10e41ee6","Type":"ContainerStarted","Data":"a8db911e711f989d1345322c8db1356a794435d19ac4d028562ea988dd90fcc4"}
Jul 07 18:46:55.639076 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.639044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfrdl" event={"ID":"88b94b6a-9327-4e28-be7d-6a3f170658c6","Type":"ContainerStarted","Data":"c3c215b8d8b602e13e87d82c2196078e62e0fb7374df3983e00fbf2cac0b2300"}
Jul 07 18:46:55.639170 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.639094    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfrdl" event={"ID":"88b94b6a-9327-4e28-be7d-6a3f170658c6","Type":"ContainerStarted","Data":"71cb3c8bd42bf671cb915a157f7901e10698836e1d21a5300648f29cb6c95809"}
Jul 07 18:46:55.639230 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.639168    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:46:55.640552 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.640525    2581 generic.go:356] "Generic (PLEG): container finished" podID="5fd04a4d-abc6-46fd-9b6a-2218b14cb140" containerID="b7615f13aea2a795793471d12f40545ff0069296031315396ac25ef911057f4b" exitCode=1
Jul 07 18:46:55.640658 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.640568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr" event={"ID":"5fd04a4d-abc6-46fd-9b6a-2218b14cb140","Type":"ContainerDied","Data":"b7615f13aea2a795793471d12f40545ff0069296031315396ac25ef911057f4b"}
Jul 07 18:46:55.640857 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.640838    2581 scope.go:117] "RemoveContainer" containerID="b7615f13aea2a795793471d12f40545ff0069296031315396ac25ef911057f4b"
Jul 07 18:46:55.689271 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:55.683956    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cfrdl" podStartSLOduration=129.810581695 podStartE2EDuration="2m11.683934215s" totalImagesPullingTime="1.87335252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:55.683546491 +0000 UTC m=+166.237437977" watchObservedRunningTime="2026-07-07 18:46:55.683934215 +0000 UTC m=+166.237825702"
Jul 07 18:46:56.246422 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:56.246390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:46:56.644990 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:56.644954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-795f5fb9b8-6g6jf" event={"ID":"56827528-2561-4873-b563-ea3923a472c6","Type":"ContainerStarted","Data":"9ebf674a6602576c4a076afb9f6e6e7364abb2cfefec278c3af43e0d19abb778"}
Jul 07 18:46:56.646356 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:56.646332    2581 generic.go:356] "Generic (PLEG): container finished" podID="02d22937-c23e-4a61-8477-db6e10e41ee6" containerID="8e125547a99145160d22a6a3d06b849a15bbcdaf0966d0a3ce8432b2cd9fd645" exitCode=0
Jul 07 18:46:56.646490 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:56.646418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4zq2" event={"ID":"02d22937-c23e-4a61-8477-db6e10e41ee6","Type":"ContainerDied","Data":"8e125547a99145160d22a6a3d06b849a15bbcdaf0966d0a3ce8432b2cd9fd645"}
Jul 07 18:46:56.648064 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:56.648038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr" event={"ID":"5fd04a4d-abc6-46fd-9b6a-2218b14cb140","Type":"ContainerStarted","Data":"3ccf672f358afe1ddbb9f7f224f2ef3ea924f5dc2eae8a2137a3fa7967f984cb"}
Jul 07 18:46:56.648375 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:56.648351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:46:56.648938 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:56.648829    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f98864f5-j4cjr"
Jul 07 18:46:57.653831 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:57.653795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4zq2" event={"ID":"02d22937-c23e-4a61-8477-db6e10e41ee6","Type":"ContainerStarted","Data":"301c8a4d5c53dfd26e0ee1bec5773d1c0c1c726b9ad036fdedc117637aa57aea"}
Jul 07 18:46:57.654180 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:57.653885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4zq2" event={"ID":"02d22937-c23e-4a61-8477-db6e10e41ee6","Type":"ContainerStarted","Data":"d5098dfbff45b2920f4cd48e574ceac4a691ef97d8ebd295f59e9ee3878a1ca4"}
Jul 07 18:46:57.679507 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:46:57.679463    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k4zq2" podStartSLOduration=2.71139157 podStartE2EDuration="3.679450367s" totalImagesPullingTime="905.663469ms" totalInitContainerRuntime="62.395328ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:57.677938263 +0000 UTC m=+168.231829750" watchObservedRunningTime="2026-07-07 18:46:57.679450367 +0000 UTC m=+168.233341853"
Jul 07 18:47:00.941351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:00.941325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:47:05.650828 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:05.650760    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cfrdl"
Jul 07 18:47:07.680514 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:07.680481    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cb84485c9-lsk7t"]
Jul 07 18:47:17.685719 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:17.685690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:47:32.700894 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:32.700832    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t" podUID="a847a161-5cd4-4f47-92a7-b63e7bf2c559" containerName="registry" containerID="cri-o://ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319" gracePeriod=30
Jul 07 18:47:32.939190 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:32.939161    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:47:33.009161 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009132    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-certificates\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009172    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a847a161-5cd4-4f47-92a7-b63e7bf2c559-ca-trust-extracted\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009203    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-installation-pull-secrets\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009224    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009271    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-image-registry-private-configuration\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009292    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-bound-sa-token\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009316    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-trusted-ca\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009339    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsm2n\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-kube-api-access-zsm2n\") pod \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\" (UID: \"a847a161-5cd4-4f47-92a7-b63e7bf2c559\") "
Jul 07 18:47:33.009784 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009750    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:47:33.009893 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.009849    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:47:33.011816 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.011785    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:47:33.011937 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.011888    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-kube-api-access-zsm2n" (OuterVolumeSpecName: "kube-api-access-zsm2n") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "kube-api-access-zsm2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:47:33.011999 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.011932    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:47:33.012100 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.012077    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:47:33.012164 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.012141    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:47:33.018571 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.018548    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a847a161-5cd4-4f47-92a7-b63e7bf2c559-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a847a161-5cd4-4f47-92a7-b63e7bf2c559" (UID: "a847a161-5cd4-4f47-92a7-b63e7bf2c559"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:47:33.109794 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109760    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a847a161-5cd4-4f47-92a7-b63e7bf2c559-ca-trust-extracted\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.109794 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109791    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-installation-pull-secrets\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.109794 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109801    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.110028 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109811    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a847a161-5cd4-4f47-92a7-b63e7bf2c559-image-registry-private-configuration\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.110028 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109821    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-bound-sa-token\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.110028 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109829    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-trusted-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.110028 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109836    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsm2n\" (UniqueName: \"kubernetes.io/projected/a847a161-5cd4-4f47-92a7-b63e7bf2c559-kube-api-access-zsm2n\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.110028 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.109844    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a847a161-5cd4-4f47-92a7-b63e7bf2c559-registry-certificates\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:47:33.767092 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.767057    2581 generic.go:356] "Generic (PLEG): container finished" podID="a847a161-5cd4-4f47-92a7-b63e7bf2c559" containerID="ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319" exitCode=0
Jul 07 18:47:33.767502 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.767103    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t"
Jul 07 18:47:33.767502 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.767104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t" event={"ID":"a847a161-5cd4-4f47-92a7-b63e7bf2c559","Type":"ContainerDied","Data":"ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319"}
Jul 07 18:47:33.767502 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.767150    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb84485c9-lsk7t" event={"ID":"a847a161-5cd4-4f47-92a7-b63e7bf2c559","Type":"ContainerDied","Data":"a1c69912533f9d470ea0fdcf6bca5e9ddac239c070b613b9c48df775f8eed979"}
Jul 07 18:47:33.767502 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.767185    2581 scope.go:117] "RemoveContainer" containerID="ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319"
Jul 07 18:47:33.775535 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.775511    2581 scope.go:117] "RemoveContainer" containerID="ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319"
Jul 07 18:47:33.775787 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:47:33.775769    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319\": container with ID starting with ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319 not found: ID does not exist" containerID="ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319"
Jul 07 18:47:33.775842 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.775796    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319"} err="failed to get container status \"ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319\": rpc error: code = NotFound desc = could not find container \"ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319\": container with ID starting with ddbcc08fe71df6ba7e559df68e86f9afa6edc91673cf94ac36ed7a4f13ca3319 not found: ID does not exist"
Jul 07 18:47:33.789678 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.789631    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cb84485c9-lsk7t"]
Jul 07 18:47:33.795003 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.794983    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cb84485c9-lsk7t"]
Jul 07 18:47:33.945003 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:33.944974    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a847a161-5cd4-4f47-92a7-b63e7bf2c559" path="/var/lib/kubelet/pods/a847a161-5cd4-4f47-92a7-b63e7bf2c559/volumes"
Jul 07 18:47:35.137841 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:35.137800    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" podUID="ea26f0ba-e281-4b1d-a1a0-f85fd244c35b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 18:47:45.137472 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:45.137432    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" podUID="ea26f0ba-e281-4b1d-a1a0-f85fd244c35b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 18:47:55.137228 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:55.137187    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" podUID="ea26f0ba-e281-4b1d-a1a0-f85fd244c35b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 18:47:55.137629 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:55.137290    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj"
Jul 07 18:47:55.137728 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:55.137712    2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"577dd3ddf7e27543a919c688e0c4e0268baed8ee691c54aeabd648c3dffb45a6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 07 18:47:55.137765 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:55.137748    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" podUID="ea26f0ba-e281-4b1d-a1a0-f85fd244c35b" containerName="service-proxy" containerID="cri-o://577dd3ddf7e27543a919c688e0c4e0268baed8ee691c54aeabd648c3dffb45a6" gracePeriod=30
Jul 07 18:47:55.840094 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:55.840061    2581 generic.go:356] "Generic (PLEG): container finished" podID="ea26f0ba-e281-4b1d-a1a0-f85fd244c35b" containerID="577dd3ddf7e27543a919c688e0c4e0268baed8ee691c54aeabd648c3dffb45a6" exitCode=2
Jul 07 18:47:55.840278 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:55.840122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" event={"ID":"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b","Type":"ContainerDied","Data":"577dd3ddf7e27543a919c688e0c4e0268baed8ee691c54aeabd648c3dffb45a6"}
Jul 07 18:47:55.840278 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:47:55.840154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-947c766bb-fz5fj" event={"ID":"ea26f0ba-e281-4b1d-a1a0-f85fd244c35b","Type":"ContainerStarted","Data":"4bd87ea58bb58df7eb053fd5254275fba45ca58cd0b1b42e7a11999fbe0a008f"}
Jul 07 18:48:21.848727 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:21.848689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:48:21.850871 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:21.850854    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2883e3-900b-479a-a926-33e779cf95b4-metrics-certs\") pod \"network-metrics-daemon-2gm48\" (UID: \"9c2883e3-900b-479a-a926-33e779cf95b4\") " pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:48:21.944903 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:21.944877    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gxh7\""
Jul 07 18:48:21.952217 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:21.952195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gm48"
Jul 07 18:48:22.080713 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:22.080685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2gm48"]
Jul 07 18:48:22.084081 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:48:22.084056    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2883e3_900b_479a_a926_33e779cf95b4.slice/crio-b94ec6f579983300370de471a839037e4d0c49bdc4c3c5656c958beb6fe66f14 WatchSource:0}: Error finding container b94ec6f579983300370de471a839037e4d0c49bdc4c3c5656c958beb6fe66f14: Status 404 returned error can't find the container with id b94ec6f579983300370de471a839037e4d0c49bdc4c3c5656c958beb6fe66f14
Jul 07 18:48:22.929778 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:22.929737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gm48" event={"ID":"9c2883e3-900b-479a-a926-33e779cf95b4","Type":"ContainerStarted","Data":"b94ec6f579983300370de471a839037e4d0c49bdc4c3c5656c958beb6fe66f14"}
Jul 07 18:48:23.934510 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:23.934472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gm48" event={"ID":"9c2883e3-900b-479a-a926-33e779cf95b4","Type":"ContainerStarted","Data":"d482f2e6facd541602784fdea71b19da409ad4b6dc8b64b1772b0ca8c0867b8d"}
Jul 07 18:48:23.934895 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:23.934532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gm48" event={"ID":"9c2883e3-900b-479a-a926-33e779cf95b4","Type":"ContainerStarted","Data":"475fabaace26cd262ab5647833263aa00ea54c97fbeb6a4c9954769588e5174c"}
Jul 07 18:48:23.953338 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:48:23.953294    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2gm48" podStartSLOduration=252.905783416 podStartE2EDuration="4m13.953276744s" totalImagesPullingTime="1.047493328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:48:23.952487801 +0000 UTC m=+254.506379288" watchObservedRunningTime="2026-07-07 18:48:23.953276744 +0000 UTC m=+254.507168234"
Jul 07 18:49:09.877686 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:09.877659    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 18:49:29.614296 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.614246    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hs8jr"]
Jul 07 18:49:29.616730 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.614475    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a847a161-5cd4-4f47-92a7-b63e7bf2c559" containerName="registry"
Jul 07 18:49:29.616730 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.614485    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a847a161-5cd4-4f47-92a7-b63e7bf2c559" containerName="registry"
Jul 07 18:49:29.616730 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.614536    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a847a161-5cd4-4f47-92a7-b63e7bf2c559" containerName="registry"
Jul 07 18:49:29.617523 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.617507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:29.620086 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.620068    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 18:49:29.620860 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.620843    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 18:49:29.620948 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.620871    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9xkmg\""
Jul 07 18:49:29.632827 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.632809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hs8jr"]
Jul 07 18:49:29.711351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.711315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29hcg\" (UniqueName: \"kubernetes.io/projected/b98d1297-09f4-480b-81d9-d5817631a9bd-kube-api-access-29hcg\") pod \"cert-manager-webhook-6486ffd997-hs8jr\" (UID: \"b98d1297-09f4-480b-81d9-d5817631a9bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:29.711503 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.711367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b98d1297-09f4-480b-81d9-d5817631a9bd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hs8jr\" (UID: \"b98d1297-09f4-480b-81d9-d5817631a9bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:29.812350 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.812308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29hcg\" (UniqueName: \"kubernetes.io/projected/b98d1297-09f4-480b-81d9-d5817631a9bd-kube-api-access-29hcg\") pod \"cert-manager-webhook-6486ffd997-hs8jr\" (UID: \"b98d1297-09f4-480b-81d9-d5817631a9bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:29.812506 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.812381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b98d1297-09f4-480b-81d9-d5817631a9bd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hs8jr\" (UID: \"b98d1297-09f4-480b-81d9-d5817631a9bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:29.821364 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.821341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b98d1297-09f4-480b-81d9-d5817631a9bd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hs8jr\" (UID: \"b98d1297-09f4-480b-81d9-d5817631a9bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:29.821485 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.821369    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29hcg\" (UniqueName: \"kubernetes.io/projected/b98d1297-09f4-480b-81d9-d5817631a9bd-kube-api-access-29hcg\") pod \"cert-manager-webhook-6486ffd997-hs8jr\" (UID: \"b98d1297-09f4-480b-81d9-d5817631a9bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:29.925761 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:29.925673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:30.054056 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:30.054022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hs8jr"]
Jul 07 18:49:30.056782 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:49:30.056754    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb98d1297_09f4_480b_81d9_d5817631a9bd.slice/crio-7a6b90c47e6b8113f2152e96cc1471e2e54f973cbf764941dbb4a359be0fcc81 WatchSource:0}: Error finding container 7a6b90c47e6b8113f2152e96cc1471e2e54f973cbf764941dbb4a359be0fcc81: Status 404 returned error can't find the container with id 7a6b90c47e6b8113f2152e96cc1471e2e54f973cbf764941dbb4a359be0fcc81
Jul 07 18:49:30.058808 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:30.058792    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:49:30.140776 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:30.140738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr" event={"ID":"b98d1297-09f4-480b-81d9-d5817631a9bd","Type":"ContainerStarted","Data":"7a6b90c47e6b8113f2152e96cc1471e2e54f973cbf764941dbb4a359be0fcc81"}
Jul 07 18:49:34.156925 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:34.156888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr" event={"ID":"b98d1297-09f4-480b-81d9-d5817631a9bd","Type":"ContainerStarted","Data":"06188dc1319b6fbb4da9ce80b5aa3cde0c866584489e3e19545a10c9786f749a"}
Jul 07 18:49:34.157418 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:34.157011    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:34.177478 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:34.177430    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr" podStartSLOduration=2.126332998 podStartE2EDuration="5.177414703s" totalImagesPullingTime="3.051081705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:34.176734783 +0000 UTC m=+324.730626268" watchObservedRunningTime="2026-07-07 18:49:34.177414703 +0000 UTC m=+324.731306189"
Jul 07 18:49:36.489549 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.489515    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"]
Jul 07 18:49:36.492489 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.492473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.495103 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.495078    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 18:49:36.495913 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.495896    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:49:36.496027 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.495911    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q7k5f\""
Jul 07 18:49:36.507966 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.507945    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"]
Jul 07 18:49:36.558392 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.558360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4aea13-5296-4b9d-809e-a86fe8c59bdb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xlcpb\" (UID: \"6b4aea13-5296-4b9d-809e-a86fe8c59bdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.558546 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.558404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w92lc\" (UniqueName: \"kubernetes.io/projected/6b4aea13-5296-4b9d-809e-a86fe8c59bdb-kube-api-access-w92lc\") pod \"openshift-lws-operator-fd8ccff4c-xlcpb\" (UID: \"6b4aea13-5296-4b9d-809e-a86fe8c59bdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.659477 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.659441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w92lc\" (UniqueName: \"kubernetes.io/projected/6b4aea13-5296-4b9d-809e-a86fe8c59bdb-kube-api-access-w92lc\") pod \"openshift-lws-operator-fd8ccff4c-xlcpb\" (UID: \"6b4aea13-5296-4b9d-809e-a86fe8c59bdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.659625 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.659509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4aea13-5296-4b9d-809e-a86fe8c59bdb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xlcpb\" (UID: \"6b4aea13-5296-4b9d-809e-a86fe8c59bdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.659832 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.659816    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4aea13-5296-4b9d-809e-a86fe8c59bdb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xlcpb\" (UID: \"6b4aea13-5296-4b9d-809e-a86fe8c59bdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.668635 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.668609    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w92lc\" (UniqueName: \"kubernetes.io/projected/6b4aea13-5296-4b9d-809e-a86fe8c59bdb-kube-api-access-w92lc\") pod \"openshift-lws-operator-fd8ccff4c-xlcpb\" (UID: \"6b4aea13-5296-4b9d-809e-a86fe8c59bdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.801588 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.801506    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"
Jul 07 18:49:36.931474 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:36.931437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb"]
Jul 07 18:49:36.933997 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:49:36.933955    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b4aea13_5296_4b9d_809e_a86fe8c59bdb.slice/crio-a0289ab8b7cca3ef40397b3864bc009b4b2e34e54a3949447316f3033588ad32 WatchSource:0}: Error finding container a0289ab8b7cca3ef40397b3864bc009b4b2e34e54a3949447316f3033588ad32: Status 404 returned error can't find the container with id a0289ab8b7cca3ef40397b3864bc009b4b2e34e54a3949447316f3033588ad32
Jul 07 18:49:37.169473 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:37.169388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb" event={"ID":"6b4aea13-5296-4b9d-809e-a86fe8c59bdb","Type":"ContainerStarted","Data":"a0289ab8b7cca3ef40397b3864bc009b4b2e34e54a3949447316f3033588ad32"}
Jul 07 18:49:40.163089 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:40.163061    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hs8jr"
Jul 07 18:49:40.182677 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:40.182647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb" event={"ID":"6b4aea13-5296-4b9d-809e-a86fe8c59bdb","Type":"ContainerStarted","Data":"7b66834e13858f5dbc80524bfc9991b27dbf62e613285b10af81b0c0058aec36"}
Jul 07 18:49:40.202600 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:40.202546    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlcpb" podStartSLOduration=1.719999777 podStartE2EDuration="4.202525168s" totalImagesPullingTime="2.482525391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:40.201830988 +0000 UTC m=+330.755722474" watchObservedRunningTime="2026-07-07 18:49:40.202525168 +0000 UTC m=+330.756416656"
Jul 07 18:49:56.065428 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.065394    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"]
Jul 07 18:49:56.071144 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.071124    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.074194 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.074172    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 18:49:56.074594 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.074572    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 18:49:56.074744 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.074728    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 18:49:56.075274 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.075240    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mqw76\""
Jul 07 18:49:56.079010 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.078994    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 18:49:56.092486 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.092461    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"]
Jul 07 18:49:56.194516 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.194489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb86d2f3-39ed-4f03-9958-177f6946216e-manifests\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.194646 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.194536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb86d2f3-39ed-4f03-9958-177f6946216e-webhook-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.194646 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.194560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb86d2f3-39ed-4f03-9958-177f6946216e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.194646 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.194589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb86d2f3-39ed-4f03-9958-177f6946216e-tmp\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.194646 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.194612    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhl9g\" (UniqueName: \"kubernetes.io/projected/bb86d2f3-39ed-4f03-9958-177f6946216e-kube-api-access-fhl9g\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.294950 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.294923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb86d2f3-39ed-4f03-9958-177f6946216e-manifests\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.295095 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.294965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb86d2f3-39ed-4f03-9958-177f6946216e-webhook-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.295095 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.294990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb86d2f3-39ed-4f03-9958-177f6946216e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.295095 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.295020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb86d2f3-39ed-4f03-9958-177f6946216e-tmp\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.295095 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.295050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhl9g\" (UniqueName: \"kubernetes.io/projected/bb86d2f3-39ed-4f03-9958-177f6946216e-kube-api-access-fhl9g\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.295358 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.295339    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb86d2f3-39ed-4f03-9958-177f6946216e-manifests\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.297360 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.297336    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb86d2f3-39ed-4f03-9958-177f6946216e-tmp\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.297591 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.297574    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb86d2f3-39ed-4f03-9958-177f6946216e-webhook-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.297652 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.297587    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb86d2f3-39ed-4f03-9958-177f6946216e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.307689 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.307668    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhl9g\" (UniqueName: \"kubernetes.io/projected/bb86d2f3-39ed-4f03-9958-177f6946216e-kube-api-access-fhl9g\") pod \"opendatahub-operator-controller-manager-545cccdbd8-jmlgg\" (UID: \"bb86d2f3-39ed-4f03-9958-177f6946216e\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.380872 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.380817    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:49:56.511898 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:56.511878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"]
Jul 07 18:49:56.513907 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:49:56.513876    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb86d2f3_39ed_4f03_9958_177f6946216e.slice/crio-8c48ac469502d14ac10a6502dc56f5d48366b8a7b01640341013921f09e16a9e WatchSource:0}: Error finding container 8c48ac469502d14ac10a6502dc56f5d48366b8a7b01640341013921f09e16a9e: Status 404 returned error can't find the container with id 8c48ac469502d14ac10a6502dc56f5d48366b8a7b01640341013921f09e16a9e
Jul 07 18:49:57.239537 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:49:57.239487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg" event={"ID":"bb86d2f3-39ed-4f03-9958-177f6946216e","Type":"ContainerStarted","Data":"8c48ac469502d14ac10a6502dc56f5d48366b8a7b01640341013921f09e16a9e"}
Jul 07 18:50:00.252467 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:00.252431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg" event={"ID":"bb86d2f3-39ed-4f03-9958-177f6946216e","Type":"ContainerStarted","Data":"f09031471bac2bf61fc8bc729c8efbc4ceb3eb0c38d39a7acbddb94376dbcdcf"}
Jul 07 18:50:01.257979 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:01.257945    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb86d2f3-39ed-4f03-9958-177f6946216e" containerID="f09031471bac2bf61fc8bc729c8efbc4ceb3eb0c38d39a7acbddb94376dbcdcf" exitCode=0
Jul 07 18:50:01.257979 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:01.257983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg" event={"ID":"bb86d2f3-39ed-4f03-9958-177f6946216e","Type":"ContainerDied","Data":"f09031471bac2bf61fc8bc729c8efbc4ceb3eb0c38d39a7acbddb94376dbcdcf"}
Jul 07 18:50:03.269827 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:03.269792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg" event={"ID":"bb86d2f3-39ed-4f03-9958-177f6946216e","Type":"ContainerStarted","Data":"b67a468887a5d38e281a1453bb7b0980254d4ed016853863d59b868dae1bcbfa"}
Jul 07 18:50:03.270236 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:03.269976    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:50:03.301622 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:03.301579    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg" podStartSLOduration=2.389923419 podStartE2EDuration="7.301565088s" totalImagesPullingTime="3.827918508s" totalInitContainerRuntime="1.083723161s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:03.299892905 +0000 UTC m=+353.853784385" watchObservedRunningTime="2026-07-07 18:50:03.301565088 +0000 UTC m=+353.855456574"
Jul 07 18:50:14.275603 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:14.275573    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-jmlgg"
Jul 07 18:50:18.285076 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.285044    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"]
Jul 07 18:50:18.293475 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.293458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.295750 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.295723    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2t2db\""
Jul 07 18:50:18.295921 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.295728    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 18:50:18.295921 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.295760    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 18:50:18.296063 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.296048    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:50:18.296102 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.296062    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 18:50:18.296230 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.296218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 18:50:18.296303 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.296218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 18:50:18.301662 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.301642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"]
Jul 07 18:50:18.359907 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.359881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2dt9\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-kube-api-access-j2dt9\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.360039 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.359927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.360039 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.359949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-token\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.360039 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.359964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.360039 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.360020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ea7b92-ec39-4051-b563-3df7019dd8b6-local-certs\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.360170 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.360052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-cacerts\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.360170 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.360078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.461342 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.461313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ea7b92-ec39-4051-b563-3df7019dd8b6-local-certs\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.461478 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.461350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-cacerts\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.461478 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.461374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.461478 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.461401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dt9\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-kube-api-access-j2dt9\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.461478 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.461434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.461478 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.461458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-token\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.461478 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.461474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.462055 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.462027    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.463792 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.463770    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.463892 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.463814    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.464012 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.463995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ea7b92-ec39-4051-b563-3df7019dd8b6-local-certs\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.464065 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.464054    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-cacerts\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.473681 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.473654    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-token\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.473771 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.473758    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dt9\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-kube-api-access-j2dt9\") pod \"istiod-openshift-gateway-7574459656-ldc8m\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.602992 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.602931    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:18.764553 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:18.764449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"]
Jul 07 18:50:18.767234 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:50:18.767211    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ea7b92_ec39_4051_b563_3df7019dd8b6.slice/crio-ee2daa258ab68cbea5a0987b2868bd7e73bc5c62c2e0277f69bb8c47dca2debb WatchSource:0}: Error finding container ee2daa258ab68cbea5a0987b2868bd7e73bc5c62c2e0277f69bb8c47dca2debb: Status 404 returned error can't find the container with id ee2daa258ab68cbea5a0987b2868bd7e73bc5c62c2e0277f69bb8c47dca2debb
Jul 07 18:50:19.326111 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:19.326067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m" event={"ID":"c5ea7b92-ec39-4051-b563-3df7019dd8b6","Type":"ContainerStarted","Data":"ee2daa258ab68cbea5a0987b2868bd7e73bc5c62c2e0277f69bb8c47dca2debb"}
Jul 07 18:50:20.962020 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:20.961977    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 18:50:20.962350 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:20.962046    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 18:50:21.335396 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:21.335358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m" event={"ID":"c5ea7b92-ec39-4051-b563-3df7019dd8b6","Type":"ContainerStarted","Data":"9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e"}
Jul 07 18:50:21.335558 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:21.335478    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:21.360169 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:21.360128    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m" podStartSLOduration=1.167657618 podStartE2EDuration="3.360114965s" totalImagesPullingTime="2.192457347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:21.358784423 +0000 UTC m=+371.912675908" watchObservedRunningTime="2026-07-07 18:50:21.360114965 +0000 UTC m=+371.914006450"
Jul 07 18:50:22.340837 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:22.340813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:23.771233 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.771201    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"]
Jul 07 18:50:23.774477 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.774461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:23.776829 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.776804    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 18:50:23.777620 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.777603    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 18:50:23.777718 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.777639    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 18:50:23.777718 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.777691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-znrn5\""
Jul 07 18:50:23.790638 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.790611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"]
Jul 07 18:50:23.902602 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.902576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7fe1941-7600-4b82-a48c-8459ba1ebda1-metrics-cert\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:23.902741 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.902607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl5cw\" (UniqueName: \"kubernetes.io/projected/e7fe1941-7600-4b82-a48c-8459ba1ebda1-kube-api-access-sl5cw\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:23.902741 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.902654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7fe1941-7600-4b82-a48c-8459ba1ebda1-manager-config\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:23.902741 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:23.902696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fe1941-7600-4b82-a48c-8459ba1ebda1-cert\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.003510 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.003481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7fe1941-7600-4b82-a48c-8459ba1ebda1-metrics-cert\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.003652 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.003515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl5cw\" (UniqueName: \"kubernetes.io/projected/e7fe1941-7600-4b82-a48c-8459ba1ebda1-kube-api-access-sl5cw\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.003652 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.003550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7fe1941-7600-4b82-a48c-8459ba1ebda1-manager-config\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.003652 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.003601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fe1941-7600-4b82-a48c-8459ba1ebda1-cert\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.004274 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.004229    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7fe1941-7600-4b82-a48c-8459ba1ebda1-manager-config\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.005896 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.005860    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7fe1941-7600-4b82-a48c-8459ba1ebda1-metrics-cert\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.005987 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.005895    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fe1941-7600-4b82-a48c-8459ba1ebda1-cert\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.011999 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.011977    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl5cw\" (UniqueName: \"kubernetes.io/projected/e7fe1941-7600-4b82-a48c-8459ba1ebda1-kube-api-access-sl5cw\") pod \"lws-controller-manager-66b96648c9-bsckb\" (UID: \"e7fe1941-7600-4b82-a48c-8459ba1ebda1\") " pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.083846 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.083793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:24.211380 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.211360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"]
Jul 07 18:50:24.213838 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:50:24.213811    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fe1941_7600_4b82_a48c_8459ba1ebda1.slice/crio-f6dfc9a725fdffb7e1897a8bb1d11c63be193867d2403c2a351ae91d25f23db9 WatchSource:0}: Error finding container f6dfc9a725fdffb7e1897a8bb1d11c63be193867d2403c2a351ae91d25f23db9: Status 404 returned error can't find the container with id f6dfc9a725fdffb7e1897a8bb1d11c63be193867d2403c2a351ae91d25f23db9
Jul 07 18:50:24.346920 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:24.346844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb" event={"ID":"e7fe1941-7600-4b82-a48c-8459ba1ebda1","Type":"ContainerStarted","Data":"f6dfc9a725fdffb7e1897a8bb1d11c63be193867d2403c2a351ae91d25f23db9"}
Jul 07 18:50:26.355698 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:26.355665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb" event={"ID":"e7fe1941-7600-4b82-a48c-8459ba1ebda1","Type":"ContainerStarted","Data":"7bf3b55e21e1c1149df80a03ccbc7721bccc42fc074cf65f85316f9037653c9d"}
Jul 07 18:50:26.356076 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:26.355799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:50:26.382018 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:26.381975    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb" podStartSLOduration=1.897303473 podStartE2EDuration="3.381962235s" totalImagesPullingTime="1.484658762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:26.380424901 +0000 UTC m=+376.934316387" watchObservedRunningTime="2026-07-07 18:50:26.381962235 +0000 UTC m=+376.935853721"
Jul 07 18:50:29.685780 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:29.685741    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"]
Jul 07 18:50:29.686207 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:29.685954    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m" podUID="c5ea7b92-ec39-4051-b563-3df7019dd8b6" containerName="discovery" containerID="cri-o://9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e" gracePeriod=30
Jul 07 18:50:29.963286 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:29.963216    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:30.051678 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.051646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-dns-cert\") pod \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") "
Jul 07 18:50:30.051869 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.051687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-ca-configmap\") pod \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") "
Jul 07 18:50:30.051869 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.051713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ea7b92-ec39-4051-b563-3df7019dd8b6-local-certs\") pod \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") "
Jul 07 18:50:30.051869 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.051754    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2dt9\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-kube-api-access-j2dt9\") pod \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") "
Jul 07 18:50:30.051869 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.051792    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-token\") pod \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") "
Jul 07 18:50:30.051869 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.051814    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-kubeconfig\") pod \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") "
Jul 07 18:50:30.051869 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.051841    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-cacerts\") pod \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\" (UID: \"c5ea7b92-ec39-4051-b563-3df7019dd8b6\") "
Jul 07 18:50:30.052172 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.052117    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c5ea7b92-ec39-4051-b563-3df7019dd8b6" (UID: "c5ea7b92-ec39-4051-b563-3df7019dd8b6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:50:30.054226 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.054185    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ea7b92-ec39-4051-b563-3df7019dd8b6-local-certs" (OuterVolumeSpecName: "local-certs") pod "c5ea7b92-ec39-4051-b563-3df7019dd8b6" (UID: "c5ea7b92-ec39-4051-b563-3df7019dd8b6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:50:30.054226 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.054194    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-kube-api-access-j2dt9" (OuterVolumeSpecName: "kube-api-access-j2dt9") pod "c5ea7b92-ec39-4051-b563-3df7019dd8b6" (UID: "c5ea7b92-ec39-4051-b563-3df7019dd8b6"). InnerVolumeSpecName "kube-api-access-j2dt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:50:30.054419 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.054324    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c5ea7b92-ec39-4051-b563-3df7019dd8b6" (UID: "c5ea7b92-ec39-4051-b563-3df7019dd8b6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:50:30.054419 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.054392    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-cacerts" (OuterVolumeSpecName: "cacerts") pod "c5ea7b92-ec39-4051-b563-3df7019dd8b6" (UID: "c5ea7b92-ec39-4051-b563-3df7019dd8b6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:50:30.054518 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.054470    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c5ea7b92-ec39-4051-b563-3df7019dd8b6" (UID: "c5ea7b92-ec39-4051-b563-3df7019dd8b6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:50:30.054518 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.054490    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5ea7b92-ec39-4051-b563-3df7019dd8b6" (UID: "c5ea7b92-ec39-4051-b563-3df7019dd8b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:50:30.153176 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.153141    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2dt9\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-kube-api-access-j2dt9\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:50:30.153176 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.153169    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-token\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:50:30.153176 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.153178    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-kubeconfig\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:50:30.153176 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.153186    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-cacerts\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:50:30.153436 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.153194    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-dns-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:50:30.153436 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.153204    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ea7b92-ec39-4051-b563-3df7019dd8b6-istio-csr-ca-configmap\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:50:30.153436 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.153212    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ea7b92-ec39-4051-b563-3df7019dd8b6-local-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:50:30.369450 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.369417    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ea7b92-ec39-4051-b563-3df7019dd8b6" containerID="9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e" exitCode=0
Jul 07 18:50:30.369608 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.369465    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"
Jul 07 18:50:30.369608 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.369501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m" event={"ID":"c5ea7b92-ec39-4051-b563-3df7019dd8b6","Type":"ContainerDied","Data":"9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e"}
Jul 07 18:50:30.369608 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.369555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m" event={"ID":"c5ea7b92-ec39-4051-b563-3df7019dd8b6","Type":"ContainerDied","Data":"ee2daa258ab68cbea5a0987b2868bd7e73bc5c62c2e0277f69bb8c47dca2debb"}
Jul 07 18:50:30.369608 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.369577    2581 scope.go:117] "RemoveContainer" containerID="9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e"
Jul 07 18:50:30.377769 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.377754    2581 scope.go:117] "RemoveContainer" containerID="9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e"
Jul 07 18:50:30.378031 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:50:30.378010    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e\": container with ID starting with 9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e not found: ID does not exist" containerID="9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e"
Jul 07 18:50:30.378074 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.378039    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e"} err="failed to get container status \"9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e\": rpc error: code = NotFound desc = could not find container \"9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e\": container with ID starting with 9d692f5ba35d7db23937d68f5bc36c383268c7eff0e41b0f461e06975a2ad55e not found: ID does not exist"
Jul 07 18:50:30.395524 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.395502    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"]
Jul 07 18:50:30.403612 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:30.403593    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldc8m"]
Jul 07 18:50:31.945918 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:31.945879    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5ea7b92-ec39-4051-b563-3df7019dd8b6" path="/var/lib/kubelet/pods/c5ea7b92-ec39-4051-b563-3df7019dd8b6/volumes"
Jul 07 18:50:37.361511 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:50:37.361485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66b96648c9-bsckb"
Jul 07 18:51:17.864785 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.864750    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fjdv"]
Jul 07 18:51:17.865221 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.865065    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ea7b92-ec39-4051-b563-3df7019dd8b6" containerName="discovery"
Jul 07 18:51:17.865221 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.865078    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ea7b92-ec39-4051-b563-3df7019dd8b6" containerName="discovery"
Jul 07 18:51:17.865221 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.865130    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ea7b92-ec39-4051-b563-3df7019dd8b6" containerName="discovery"
Jul 07 18:51:17.868307 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.868291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv"
Jul 07 18:51:17.870888 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.870858    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-h2sh2\""
Jul 07 18:51:17.870888 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.870881    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:51:17.871645 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.871631    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:51:17.881881 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.881857    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fjdv"]
Jul 07 18:51:17.991584 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:17.991543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb9pm\" (UniqueName: \"kubernetes.io/projected/c67ba1e6-5555-48bc-9fae-f2ee53f95959-kube-api-access-vb9pm\") pod \"kuadrant-operator-catalog-5fjdv\" (UID: \"c67ba1e6-5555-48bc-9fae-f2ee53f95959\") " pod="kuadrant-system/kuadrant-operator-catalog-5fjdv"
Jul 07 18:51:18.092515 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.092471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb9pm\" (UniqueName: \"kubernetes.io/projected/c67ba1e6-5555-48bc-9fae-f2ee53f95959-kube-api-access-vb9pm\") pod \"kuadrant-operator-catalog-5fjdv\" (UID: \"c67ba1e6-5555-48bc-9fae-f2ee53f95959\") " pod="kuadrant-system/kuadrant-operator-catalog-5fjdv"
Jul 07 18:51:18.103096 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.103070    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb9pm\" (UniqueName: \"kubernetes.io/projected/c67ba1e6-5555-48bc-9fae-f2ee53f95959-kube-api-access-vb9pm\") pod \"kuadrant-operator-catalog-5fjdv\" (UID: \"c67ba1e6-5555-48bc-9fae-f2ee53f95959\") " pod="kuadrant-system/kuadrant-operator-catalog-5fjdv"
Jul 07 18:51:18.178376 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.178270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv"
Jul 07 18:51:18.221447 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.221415    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fjdv"]
Jul 07 18:51:18.310798 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.310665    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fjdv"]
Jul 07 18:51:18.313343 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:51:18.313316    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67ba1e6_5555_48bc_9fae_f2ee53f95959.slice/crio-dc93f6632b807d2cc21a5acf491366e475cc47f2d6882337c5b02052b44bd826 WatchSource:0}: Error finding container dc93f6632b807d2cc21a5acf491366e475cc47f2d6882337c5b02052b44bd826: Status 404 returned error can't find the container with id dc93f6632b807d2cc21a5acf491366e475cc47f2d6882337c5b02052b44bd826
Jul 07 18:51:18.437334 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.437237    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lcswn"]
Jul 07 18:51:18.441461 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.441443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:18.449202 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.449177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lcswn"]
Jul 07 18:51:18.496171 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.496137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7dbc\" (UniqueName: \"kubernetes.io/projected/81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06-kube-api-access-v7dbc\") pod \"kuadrant-operator-catalog-lcswn\" (UID: \"81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06\") " pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:18.544222 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.544184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv" event={"ID":"c67ba1e6-5555-48bc-9fae-f2ee53f95959","Type":"ContainerStarted","Data":"dc93f6632b807d2cc21a5acf491366e475cc47f2d6882337c5b02052b44bd826"}
Jul 07 18:51:18.596711 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.596662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7dbc\" (UniqueName: \"kubernetes.io/projected/81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06-kube-api-access-v7dbc\") pod \"kuadrant-operator-catalog-lcswn\" (UID: \"81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06\") " pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:18.604794 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.604769    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7dbc\" (UniqueName: \"kubernetes.io/projected/81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06-kube-api-access-v7dbc\") pod \"kuadrant-operator-catalog-lcswn\" (UID: \"81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06\") " pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:18.752044 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.752003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:18.895095 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:18.895021    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lcswn"]
Jul 07 18:51:18.910241 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:51:18.910214    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c61bb9_b28b_4f21_9d0b_a6dc7a2bfe06.slice/crio-8f6d44713ea4bade0ca67d28a9e79c1686d0e7c62cba1bdca9f6e24b68f7bf3b WatchSource:0}: Error finding container 8f6d44713ea4bade0ca67d28a9e79c1686d0e7c62cba1bdca9f6e24b68f7bf3b: Status 404 returned error can't find the container with id 8f6d44713ea4bade0ca67d28a9e79c1686d0e7c62cba1bdca9f6e24b68f7bf3b
Jul 07 18:51:19.550620 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:19.550557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lcswn" event={"ID":"81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06","Type":"ContainerStarted","Data":"8f6d44713ea4bade0ca67d28a9e79c1686d0e7c62cba1bdca9f6e24b68f7bf3b"}
Jul 07 18:51:20.557460 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.557381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lcswn" event={"ID":"81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06","Type":"ContainerStarted","Data":"2c2109943b3a49ca9d8589e6f08a9fe567877c24e61aadc1117f075f847d6497"}
Jul 07 18:51:20.566085 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.566042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv" event={"ID":"c67ba1e6-5555-48bc-9fae-f2ee53f95959","Type":"ContainerStarted","Data":"7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba"}
Jul 07 18:51:20.566468 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.566423    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv" podUID="c67ba1e6-5555-48bc-9fae-f2ee53f95959" containerName="registry-server" containerID="cri-o://7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba" gracePeriod=2
Jul 07 18:51:20.575986 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.575915    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lcswn" podStartSLOduration=1.02753691 podStartE2EDuration="2.57589639s" totalImagesPullingTime="1.54835948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:20.57568091 +0000 UTC m=+431.129572396" watchObservedRunningTime="2026-07-07 18:51:20.57589639 +0000 UTC m=+431.129787877"
Jul 07 18:51:20.593359 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.593314    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv" podStartSLOduration=1.45077726 podStartE2EDuration="3.593294831s" totalImagesPullingTime="2.142517571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:20.592992785 +0000 UTC m=+431.146884272" watchObservedRunningTime="2026-07-07 18:51:20.593294831 +0000 UTC m=+431.147186318"
Jul 07 18:51:20.793572 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.793550    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5fjdv_c67ba1e6-5555-48bc-9fae-f2ee53f95959/registry-server/0.log"
Jul 07 18:51:20.795872 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.795855    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv"
Jul 07 18:51:20.914980 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.914948    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb9pm\" (UniqueName: \"kubernetes.io/projected/c67ba1e6-5555-48bc-9fae-f2ee53f95959-kube-api-access-vb9pm\") pod \"c67ba1e6-5555-48bc-9fae-f2ee53f95959\" (UID: \"c67ba1e6-5555-48bc-9fae-f2ee53f95959\") "
Jul 07 18:51:20.917119 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:20.917093    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c67ba1e6-5555-48bc-9fae-f2ee53f95959-kube-api-access-vb9pm" (OuterVolumeSpecName: "kube-api-access-vb9pm") pod "c67ba1e6-5555-48bc-9fae-f2ee53f95959" (UID: "c67ba1e6-5555-48bc-9fae-f2ee53f95959"). InnerVolumeSpecName "kube-api-access-vb9pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:21.016321 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.016286    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb9pm\" (UniqueName: \"kubernetes.io/projected/c67ba1e6-5555-48bc-9fae-f2ee53f95959-kube-api-access-vb9pm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:51:21.571575 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.571548    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5fjdv_c67ba1e6-5555-48bc-9fae-f2ee53f95959/registry-server/0.log"
Jul 07 18:51:21.571939 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.571587    2581 generic.go:356] "Generic (PLEG): container finished" podID="c67ba1e6-5555-48bc-9fae-f2ee53f95959" containerID="7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba" exitCode=1
Jul 07 18:51:21.571939 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.571630    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv"
Jul 07 18:51:21.571939 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.571672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv" event={"ID":"c67ba1e6-5555-48bc-9fae-f2ee53f95959","Type":"ContainerDied","Data":"7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba"}
Jul 07 18:51:21.571939 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.571715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5fjdv" event={"ID":"c67ba1e6-5555-48bc-9fae-f2ee53f95959","Type":"ContainerDied","Data":"dc93f6632b807d2cc21a5acf491366e475cc47f2d6882337c5b02052b44bd826"}
Jul 07 18:51:21.571939 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.571738    2581 scope.go:117] "RemoveContainer" containerID="7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba"
Jul 07 18:51:21.580034 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.580018    2581 scope.go:117] "RemoveContainer" containerID="7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba"
Jul 07 18:51:21.580287 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:51:21.580269    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba\": container with ID starting with 7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba not found: ID does not exist" containerID="7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba"
Jul 07 18:51:21.580349 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.580293    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba"} err="failed to get container status \"7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba\": rpc error: code = NotFound desc = could not find container \"7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba\": container with ID starting with 7c2967811fabc69ea1027e56f9c8051489a8da8c8775d5fcd0bc2c275c90f3ba not found: ID does not exist"
Jul 07 18:51:21.592887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.592866    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fjdv"]
Jul 07 18:51:21.597975 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.597957    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5fjdv"]
Jul 07 18:51:21.945928 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:21.945899    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c67ba1e6-5555-48bc-9fae-f2ee53f95959" path="/var/lib/kubelet/pods/c67ba1e6-5555-48bc-9fae-f2ee53f95959/volumes"
Jul 07 18:51:28.752339 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:28.752305    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:28.752765 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:28.752365    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:28.774443 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:28.774414    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:29.625093 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:29.625065    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lcswn"
Jul 07 18:51:49.710990 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.710958    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"]
Jul 07 18:51:49.711452 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.711223    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c67ba1e6-5555-48bc-9fae-f2ee53f95959" containerName="registry-server"
Jul 07 18:51:49.711452 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.711233    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c67ba1e6-5555-48bc-9fae-f2ee53f95959" containerName="registry-server"
Jul 07 18:51:49.711452 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.711308    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c67ba1e6-5555-48bc-9fae-f2ee53f95959" containerName="registry-server"
Jul 07 18:51:49.716746 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.716727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:51:49.719229 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.719210    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fhxm4\""
Jul 07 18:51:49.727744 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.727722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"]
Jul 07 18:51:49.836307 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.836275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq8jz\" (UniqueName: \"kubernetes.io/projected/27d42d39-605c-42c5-90b7-dedfdca91359-kube-api-access-zq8jz\") pod \"limitador-operator-controller-manager-859d7b78bd-jpdjc\" (UID: \"27d42d39-605c-42c5-90b7-dedfdca91359\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:51:49.937523 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.937486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq8jz\" (UniqueName: \"kubernetes.io/projected/27d42d39-605c-42c5-90b7-dedfdca91359-kube-api-access-zq8jz\") pod \"limitador-operator-controller-manager-859d7b78bd-jpdjc\" (UID: \"27d42d39-605c-42c5-90b7-dedfdca91359\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:51:49.948906 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:49.948873    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq8jz\" (UniqueName: \"kubernetes.io/projected/27d42d39-605c-42c5-90b7-dedfdca91359-kube-api-access-zq8jz\") pod \"limitador-operator-controller-manager-859d7b78bd-jpdjc\" (UID: \"27d42d39-605c-42c5-90b7-dedfdca91359\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:51:50.026118 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:50.026084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:51:50.154119 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:50.154092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"]
Jul 07 18:51:50.156803 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:51:50.156776    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d42d39_605c_42c5_90b7_dedfdca91359.slice/crio-979c3baab0d1a924f110084dad4edb2be959d6132fb7856b9aa48a67ce221631 WatchSource:0}: Error finding container 979c3baab0d1a924f110084dad4edb2be959d6132fb7856b9aa48a67ce221631: Status 404 returned error can't find the container with id 979c3baab0d1a924f110084dad4edb2be959d6132fb7856b9aa48a67ce221631
Jul 07 18:51:50.689321 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:50.689289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc" event={"ID":"27d42d39-605c-42c5-90b7-dedfdca91359","Type":"ContainerStarted","Data":"979c3baab0d1a924f110084dad4edb2be959d6132fb7856b9aa48a67ce221631"}
Jul 07 18:51:52.699713 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:52.699678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc" event={"ID":"27d42d39-605c-42c5-90b7-dedfdca91359","Type":"ContainerStarted","Data":"63c59395cf8c162dc133a21aed1940cd6444688b44985cc355d6be4c0b185d81"}
Jul 07 18:51:52.700159 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:52.699785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:51:52.718853 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:52.718809    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc" podStartSLOduration=2.063062099 podStartE2EDuration="3.718796531s" totalImagesPullingTime="1.655734432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:52.717703479 +0000 UTC m=+463.271594967" watchObservedRunningTime="2026-07-07 18:51:52.718796531 +0000 UTC m=+463.272688016"
Jul 07 18:51:54.607243 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.607200    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"]
Jul 07 18:51:54.610669 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.610646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:54.612739 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.612719    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2bl8b\""
Jul 07 18:51:54.632525 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.632502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"]
Jul 07 18:51:54.775240 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.775212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:54.775394 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.775335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zqv\" (UniqueName: \"kubernetes.io/projected/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-kube-api-access-s7zqv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:54.876090 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.876003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:54.876090 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.876080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zqv\" (UniqueName: \"kubernetes.io/projected/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-kube-api-access-s7zqv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:54.876411 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.876388    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:54.888978 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.888957    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zqv\" (UniqueName: \"kubernetes.io/projected/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-kube-api-access-s7zqv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:54.924886 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:54.924866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:51:55.050221 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:55.050195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"]
Jul 07 18:51:55.053008 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:51:55.052979    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb6f272_7272_49f2_b429_b1b7fcb4e6f7.slice/crio-30a61a97837028afbeaa078998370e55f10701fbac1095ff2280a6416e29a8b5 WatchSource:0}: Error finding container 30a61a97837028afbeaa078998370e55f10701fbac1095ff2280a6416e29a8b5: Status 404 returned error can't find the container with id 30a61a97837028afbeaa078998370e55f10701fbac1095ff2280a6416e29a8b5
Jul 07 18:51:55.711699 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:51:55.711669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr" event={"ID":"acb6f272-7272-49f2-b429-b1b7fcb4e6f7","Type":"ContainerStarted","Data":"30a61a97837028afbeaa078998370e55f10701fbac1095ff2280a6416e29a8b5"}
Jul 07 18:52:02.743499 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:02.743468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr" event={"ID":"acb6f272-7272-49f2-b429-b1b7fcb4e6f7","Type":"ContainerStarted","Data":"0539861114baae9af27f7c44ca259c87d9e30ba30a40148a73a06afe343594bd"}
Jul 07 18:52:02.743887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:02.743602    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:02.765017 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:02.764965    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr" podStartSLOduration=1.8927413419999999 podStartE2EDuration="8.764949289s" totalImagesPullingTime="6.872207947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:02.76441444 +0000 UTC m=+473.318305926" watchObservedRunningTime="2026-07-07 18:52:02.764949289 +0000 UTC m=+473.318840777"
Jul 07 18:52:03.705316 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:03.705289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:52:13.750655 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:13.750611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.063371 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.063327    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"]
Jul 07 18:52:15.067679 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.067662    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.081111 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.081085    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"]
Jul 07 18:52:15.138843 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.138813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxms8\" (UniqueName: \"kubernetes.io/projected/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-kube-api-access-rxms8\") pod \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.138998 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.138848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.239770 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.239730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxms8\" (UniqueName: \"kubernetes.io/projected/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-kube-api-access-rxms8\") pod \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.239770 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.239774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.240113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.240098    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.250588 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.250562    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxms8\" (UniqueName: \"kubernetes.io/projected/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-kube-api-access-rxms8\") pod \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.376748 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.376652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.510535 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.510462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"]
Jul 07 18:52:15.513017 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:52:15.512991    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba39b20_d231_4605_92a3_4a2cbd6cb3c0.slice/crio-0ae641a6abeccd7bfca350f7b54a0289b6b97e038128bfe4a16998fdf0919e69 WatchSource:0}: Error finding container 0ae641a6abeccd7bfca350f7b54a0289b6b97e038128bfe4a16998fdf0919e69: Status 404 returned error can't find the container with id 0ae641a6abeccd7bfca350f7b54a0289b6b97e038128bfe4a16998fdf0919e69
Jul 07 18:52:15.579906 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.579880    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"]
Jul 07 18:52:15.588758 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.588737    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"]
Jul 07 18:52:15.600714 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.600690    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"]
Jul 07 18:52:15.600902 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.600878    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" containerName="manager" containerID="cri-o://0539861114baae9af27f7c44ca259c87d9e30ba30a40148a73a06afe343594bd" gracePeriod=2
Jul 07 18:52:15.611031 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.611005    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"]
Jul 07 18:52:15.614079 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.614055    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"]
Jul 07 18:52:15.614443 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.614422    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" containerName="manager"
Jul 07 18:52:15.614443 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.614444    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" containerName="manager"
Jul 07 18:52:15.614577 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.614463    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" containerName="manager"
Jul 07 18:52:15.614577 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.614471    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" containerName="manager"
Jul 07 18:52:15.614577 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.614549    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" containerName="manager"
Jul 07 18:52:15.614577 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.614560    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" containerName="manager"
Jul 07 18:52:15.617387 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.617342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:15.625143 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.625107    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.626339 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.626318    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"]
Jul 07 18:52:15.626527 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.626502    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" containerName="manager" containerID="cri-o://63c59395cf8c162dc133a21aed1940cd6444688b44985cc355d6be4c0b185d81" gracePeriod=2
Jul 07 18:52:15.628243 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.628221    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"]
Jul 07 18:52:15.631307 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.631286    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:15.633316 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.633297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"]
Jul 07 18:52:15.638953 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.638934    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"]
Jul 07 18:52:15.648349 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.648320    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"]
Jul 07 18:52:15.654961 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.654914    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.655217 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.655194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7jx\" (UniqueName: \"kubernetes.io/projected/bcc65e04-8d39-4726-bfb1-489c74cd12ba-kube-api-access-8l7jx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tnd2w\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:15.655306 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.655278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcc65e04-8d39-4726-bfb1-489c74cd12ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tnd2w\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:15.689490 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.689447    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.691323 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.691299    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jpdjc\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:52:15.756228 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.756192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcc65e04-8d39-4726-bfb1-489c74cd12ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tnd2w\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:15.756409 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.756313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7jx\" (UniqueName: \"kubernetes.io/projected/bcc65e04-8d39-4726-bfb1-489c74cd12ba-kube-api-access-8l7jx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tnd2w\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:15.756409 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.756381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t462s\" (UniqueName: \"kubernetes.io/projected/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-kube-api-access-t462s\") pod \"kuadrant-operator-controller-manager-55467d9f7-ms2lr\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:15.756530 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.756416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ms2lr\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:15.756592 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.756567    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcc65e04-8d39-4726-bfb1-489c74cd12ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tnd2w\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:15.773770 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.773742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7jx\" (UniqueName: \"kubernetes.io/projected/bcc65e04-8d39-4726-bfb1-489c74cd12ba-kube-api-access-8l7jx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tnd2w\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:15.796544 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.796387    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" containerName="manager" containerID="cri-o://cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc" gracePeriod=2
Jul 07 18:52:15.798408 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.798375    2581 generic.go:356] "Generic (PLEG): container finished" podID="27d42d39-605c-42c5-90b7-dedfdca91359" containerID="63c59395cf8c162dc133a21aed1940cd6444688b44985cc355d6be4c0b185d81" exitCode=0
Jul 07 18:52:15.798638 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.798608    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.800354 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.800328    2581 generic.go:356] "Generic (PLEG): container finished" podID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" containerID="0539861114baae9af27f7c44ca259c87d9e30ba30a40148a73a06afe343594bd" exitCode=0
Jul 07 18:52:15.800491 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.800455    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.802301 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.802269    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jpdjc\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:52:15.857267 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.857229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t462s\" (UniqueName: \"kubernetes.io/projected/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-kube-api-access-t462s\") pod \"kuadrant-operator-controller-manager-55467d9f7-ms2lr\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:15.857397 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.857337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ms2lr\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:15.857694 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.857677    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ms2lr\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:15.870919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.870901    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t462s\" (UniqueName: \"kubernetes.io/projected/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-kube-api-access-t462s\") pod \"kuadrant-operator-controller-manager-55467d9f7-ms2lr\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:15.909308 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.909285    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.911735 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.911701    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.912358 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.912338    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:52:15.913600 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.913578    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.915379 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.915357    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jpdjc\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:52:15.917063 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.917040    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:15.918656 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.918637    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xk6wr\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:15.920297 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:15.920276    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jpdjc\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:52:15.957719 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.957683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7zqv\" (UniqueName: \"kubernetes.io/projected/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-kube-api-access-s7zqv\") pod \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") "
Jul 07 18:52:15.957877 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.957741    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-extensions-socket-volume\") pod \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\" (UID: \"acb6f272-7272-49f2-b429-b1b7fcb4e6f7\") "
Jul 07 18:52:15.957877 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.957808    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq8jz\" (UniqueName: \"kubernetes.io/projected/27d42d39-605c-42c5-90b7-dedfdca91359-kube-api-access-zq8jz\") pod \"27d42d39-605c-42c5-90b7-dedfdca91359\" (UID: \"27d42d39-605c-42c5-90b7-dedfdca91359\") "
Jul 07 18:52:15.958142 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.958114    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "acb6f272-7272-49f2-b429-b1b7fcb4e6f7" (UID: "acb6f272-7272-49f2-b429-b1b7fcb4e6f7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:52:15.959733 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.959706    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-kube-api-access-s7zqv" (OuterVolumeSpecName: "kube-api-access-s7zqv") pod "acb6f272-7272-49f2-b429-b1b7fcb4e6f7" (UID: "acb6f272-7272-49f2-b429-b1b7fcb4e6f7"). InnerVolumeSpecName "kube-api-access-s7zqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:15.959833 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:15.959809    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d42d39-605c-42c5-90b7-dedfdca91359-kube-api-access-zq8jz" (OuterVolumeSpecName: "kube-api-access-zq8jz") pod "27d42d39-605c-42c5-90b7-dedfdca91359" (UID: "27d42d39-605c-42c5-90b7-dedfdca91359"). InnerVolumeSpecName "kube-api-access-zq8jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:16.040870 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.040844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:16.042103 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.042077    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:16.047674 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.047654    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:16.058746 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.058712    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-extensions-socket-volume\") pod \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") "
Jul 07 18:52:16.058856 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.058790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxms8\" (UniqueName: \"kubernetes.io/projected/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-kube-api-access-rxms8\") pod \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\" (UID: \"4ba39b20-d231-4605-92a3-4a2cbd6cb3c0\") "
Jul 07 18:52:16.058978 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.058952    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" (UID: "4ba39b20-d231-4605-92a3-4a2cbd6cb3c0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:52:16.059077 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.059058    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-extensions-socket-volume\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:16.059130 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.059085    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-extensions-socket-volume\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:16.059130 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.059107    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq8jz\" (UniqueName: \"kubernetes.io/projected/27d42d39-605c-42c5-90b7-dedfdca91359-kube-api-access-zq8jz\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:16.059130 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.059123    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7zqv\" (UniqueName: \"kubernetes.io/projected/acb6f272-7272-49f2-b429-b1b7fcb4e6f7-kube-api-access-s7zqv\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:16.060712 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.060688    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-kube-api-access-rxms8" (OuterVolumeSpecName: "kube-api-access-rxms8") pod "4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" (UID: "4ba39b20-d231-4605-92a3-4a2cbd6cb3c0"). InnerVolumeSpecName "kube-api-access-rxms8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:16.159784 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.159704    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxms8\" (UniqueName: \"kubernetes.io/projected/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0-kube-api-access-rxms8\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:16.184169 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.184144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"]
Jul 07 18:52:16.187320 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:52:16.187289    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a93ad7_7f92_407e_a5ec_8ddbd9d53216.slice/crio-31329e57c1eb2f84a2c8939830338e6d48126837cb0e84a15b861329cf4d9d29 WatchSource:0}: Error finding container 31329e57c1eb2f84a2c8939830338e6d48126837cb0e84a15b861329cf4d9d29: Status 404 returned error can't find the container with id 31329e57c1eb2f84a2c8939830338e6d48126837cb0e84a15b861329cf4d9d29
Jul 07 18:52:16.204008 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.203981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"]
Jul 07 18:52:16.206809 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:52:16.206783    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc65e04_8d39_4726_bfb1_489c74cd12ba.slice/crio-b80be433c8d1c327e42b7fb6616fc53556a7c0e307edb7a8782a0b51df2fd6dc WatchSource:0}: Error finding container b80be433c8d1c327e42b7fb6616fc53556a7c0e307edb7a8782a0b51df2fd6dc: Status 404 returned error can't find the container with id b80be433c8d1c327e42b7fb6616fc53556a7c0e307edb7a8782a0b51df2fd6dc
Jul 07 18:52:16.807018 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.806979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w" event={"ID":"bcc65e04-8d39-4726-bfb1-489c74cd12ba","Type":"ContainerStarted","Data":"0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be"}
Jul 07 18:52:16.807195 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.807150    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:16.807195 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.807190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w" event={"ID":"bcc65e04-8d39-4726-bfb1-489c74cd12ba","Type":"ContainerStarted","Data":"b80be433c8d1c327e42b7fb6616fc53556a7c0e307edb7a8782a0b51df2fd6dc"}
Jul 07 18:52:16.808348 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.808331    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xk6wr"
Jul 07 18:52:16.808458 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.808357    2581 scope.go:117] "RemoveContainer" containerID="0539861114baae9af27f7c44ca259c87d9e30ba30a40148a73a06afe343594bd"
Jul 07 18:52:16.810887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.809929    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" containerID="cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc" exitCode=2
Jul 07 18:52:16.810887 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.810044    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:16.815644 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.815621    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpdjc"
Jul 07 18:52:16.821281 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.821158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr" event={"ID":"69a93ad7-7f92-407e-a5ec-8ddbd9d53216","Type":"ContainerStarted","Data":"0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991"}
Jul 07 18:52:16.821281 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.821209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr" event={"ID":"69a93ad7-7f92-407e-a5ec-8ddbd9d53216","Type":"ContainerStarted","Data":"31329e57c1eb2f84a2c8939830338e6d48126837cb0e84a15b861329cf4d9d29"}
Jul 07 18:52:16.821477 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.821439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:16.823517 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.823501    2581 scope.go:117] "RemoveContainer" containerID="cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc"
Jul 07 18:52:16.830921 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.830906    2581 scope.go:117] "RemoveContainer" containerID="cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc"
Jul 07 18:52:16.831162 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:16.831147    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc\": container with ID starting with cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc not found: ID does not exist" containerID="cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc"
Jul 07 18:52:16.831206 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.831170    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc"} err="failed to get container status \"cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc\": rpc error: code = NotFound desc = could not find container \"cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc\": container with ID starting with cfc4262d22c0b1a20104cbe48f8402b3a95cff4ddcd4b3683208422f552e94bc not found: ID does not exist"
Jul 07 18:52:16.831206 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.831185    2581 scope.go:117] "RemoveContainer" containerID="63c59395cf8c162dc133a21aed1940cd6444688b44985cc355d6be4c0b185d81"
Jul 07 18:52:16.836444 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.836402    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w" podStartSLOduration=1.836385752 podStartE2EDuration="1.836385752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:16.834955155 +0000 UTC m=+487.388846643" watchObservedRunningTime="2026-07-07 18:52:16.836385752 +0000 UTC m=+487.390277239"
Jul 07 18:52:16.862706 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:16.862609    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6ts45\" is forbidden: User \"system:node:ip-10-0-135-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-133.ec2.internal' and this object" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6ts45"
Jul 07 18:52:16.863993 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:16.863953    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr" podStartSLOduration=1.8639382260000001 podStartE2EDuration="1.863938226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:16.859400209 +0000 UTC m=+487.413291696" watchObservedRunningTime="2026-07-07 18:52:16.863938226 +0000 UTC m=+487.417829711"
Jul 07 18:52:17.946853 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:17.946818    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" path="/var/lib/kubelet/pods/27d42d39-605c-42c5-90b7-dedfdca91359/volumes"
Jul 07 18:52:17.947191 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:17.947154    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ba39b20-d231-4605-92a3-4a2cbd6cb3c0" path="/var/lib/kubelet/pods/4ba39b20-d231-4605-92a3-4a2cbd6cb3c0/volumes"
Jul 07 18:52:17.947484 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:17.947471    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acb6f272-7272-49f2-b429-b1b7fcb4e6f7" path="/var/lib/kubelet/pods/acb6f272-7272-49f2-b429-b1b7fcb4e6f7/volumes"
Jul 07 18:52:27.830896 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:27.830869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:27.831386 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:27.830936    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:27.961995 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:27.961961    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"]
Jul 07 18:52:27.962173 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:27.962149    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w" podUID="bcc65e04-8d39-4726-bfb1-489c74cd12ba" containerName="manager" containerID="cri-o://0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be" gracePeriod=10
Jul 07 18:52:28.210684 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.210664    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:28.245262 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.245227    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l7jx\" (UniqueName: \"kubernetes.io/projected/bcc65e04-8d39-4726-bfb1-489c74cd12ba-kube-api-access-8l7jx\") pod \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") "
Jul 07 18:52:28.245376 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.245305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcc65e04-8d39-4726-bfb1-489c74cd12ba-extensions-socket-volume\") pod \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\" (UID: \"bcc65e04-8d39-4726-bfb1-489c74cd12ba\") "
Jul 07 18:52:28.245747 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.245724    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcc65e04-8d39-4726-bfb1-489c74cd12ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bcc65e04-8d39-4726-bfb1-489c74cd12ba" (UID: "bcc65e04-8d39-4726-bfb1-489c74cd12ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:52:28.247214 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.247194    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc65e04-8d39-4726-bfb1-489c74cd12ba-kube-api-access-8l7jx" (OuterVolumeSpecName: "kube-api-access-8l7jx") pod "bcc65e04-8d39-4726-bfb1-489c74cd12ba" (UID: "bcc65e04-8d39-4726-bfb1-489c74cd12ba"). InnerVolumeSpecName "kube-api-access-8l7jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:28.315306 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.315279    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"]
Jul 07 18:52:28.315537 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.315524    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc65e04-8d39-4726-bfb1-489c74cd12ba" containerName="manager"
Jul 07 18:52:28.315587 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.315539    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc65e04-8d39-4726-bfb1-489c74cd12ba" containerName="manager"
Jul 07 18:52:28.315587 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.315558    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" containerName="manager"
Jul 07 18:52:28.315587 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.315564    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" containerName="manager"
Jul 07 18:52:28.315691 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.315601    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d42d39-605c-42c5-90b7-dedfdca91359" containerName="manager"
Jul 07 18:52:28.315691 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.315609    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc65e04-8d39-4726-bfb1-489c74cd12ba" containerName="manager"
Jul 07 18:52:28.319113 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.319097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.337482 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.337459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"]
Jul 07 18:52:28.346084 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.346055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f442d87-9944-400b-b45c-969e9bdf0156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-njrs7\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.346183 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.346156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc4bb\" (UniqueName: \"kubernetes.io/projected/0f442d87-9944-400b-b45c-969e9bdf0156-kube-api-access-bc4bb\") pod \"kuadrant-operator-controller-manager-86878c769f-njrs7\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.346230 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.346208    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcc65e04-8d39-4726-bfb1-489c74cd12ba-extensions-socket-volume\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:28.346230 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.346219    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l7jx\" (UniqueName: \"kubernetes.io/projected/bcc65e04-8d39-4726-bfb1-489c74cd12ba-kube-api-access-8l7jx\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:28.446778 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.446702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc4bb\" (UniqueName: \"kubernetes.io/projected/0f442d87-9944-400b-b45c-969e9bdf0156-kube-api-access-bc4bb\") pod \"kuadrant-operator-controller-manager-86878c769f-njrs7\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.446778 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.446752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f442d87-9944-400b-b45c-969e9bdf0156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-njrs7\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.447037 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.447022    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f442d87-9944-400b-b45c-969e9bdf0156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-njrs7\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.463050 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.463027    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc4bb\" (UniqueName: \"kubernetes.io/projected/0f442d87-9944-400b-b45c-969e9bdf0156-kube-api-access-bc4bb\") pod \"kuadrant-operator-controller-manager-86878c769f-njrs7\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.628705 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.628675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.769105 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.769073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"]
Jul 07 18:52:28.770138 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:52:28.770116    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f442d87_9944_400b_b45c_969e9bdf0156.slice/crio-14ed146c59b1a787f9eaae1225d6e5aff27c1cda4e5f13a46ac5048f35439b2c WatchSource:0}: Error finding container 14ed146c59b1a787f9eaae1225d6e5aff27c1cda4e5f13a46ac5048f35439b2c: Status 404 returned error can't find the container with id 14ed146c59b1a787f9eaae1225d6e5aff27c1cda4e5f13a46ac5048f35439b2c
Jul 07 18:52:28.878913 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.878879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7" event={"ID":"0f442d87-9944-400b-b45c-969e9bdf0156","Type":"ContainerStarted","Data":"35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257"}
Jul 07 18:52:28.879301 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.878934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7" event={"ID":"0f442d87-9944-400b-b45c-969e9bdf0156","Type":"ContainerStarted","Data":"14ed146c59b1a787f9eaae1225d6e5aff27c1cda4e5f13a46ac5048f35439b2c"}
Jul 07 18:52:28.879301 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.878987    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:28.880179 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.880156    2581 generic.go:356] "Generic (PLEG): container finished" podID="bcc65e04-8d39-4726-bfb1-489c74cd12ba" containerID="0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be" exitCode=0
Jul 07 18:52:28.880289 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.880200    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"
Jul 07 18:52:28.880289 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.880235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w" event={"ID":"bcc65e04-8d39-4726-bfb1-489c74cd12ba","Type":"ContainerDied","Data":"0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be"}
Jul 07 18:52:28.880375 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.880289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w" event={"ID":"bcc65e04-8d39-4726-bfb1-489c74cd12ba","Type":"ContainerDied","Data":"b80be433c8d1c327e42b7fb6616fc53556a7c0e307edb7a8782a0b51df2fd6dc"}
Jul 07 18:52:28.880375 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.880311    2581 scope.go:117] "RemoveContainer" containerID="0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be"
Jul 07 18:52:28.888776 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.888760    2581 scope.go:117] "RemoveContainer" containerID="0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be"
Jul 07 18:52:28.889030 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:28.889012    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be\": container with ID starting with 0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be not found: ID does not exist" containerID="0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be"
Jul 07 18:52:28.889071 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.889038    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be"} err="failed to get container status \"0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be\": rpc error: code = NotFound desc = could not find container \"0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be\": container with ID starting with 0975a803be06665b156ebec935f842c70674f3bb7a9a7858d1ae62d8cfe493be not found: ID does not exist"
Jul 07 18:52:28.907781 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.907740    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7" podStartSLOduration=0.907727996 podStartE2EDuration="907.727996ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:28.907272787 +0000 UTC m=+499.461164274" watchObservedRunningTime="2026-07-07 18:52:28.907727996 +0000 UTC m=+499.461619481"
Jul 07 18:52:28.930863 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.930838    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"]
Jul 07 18:52:28.934004 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:28.933986    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tnd2w"]
Jul 07 18:52:29.946188 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:29.946156    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc65e04-8d39-4726-bfb1-489c74cd12ba" path="/var/lib/kubelet/pods/bcc65e04-8d39-4726-bfb1-489c74cd12ba/volumes"
Jul 07 18:52:39.888379 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:39.888347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 18:52:39.947017 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:39.946986    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"]
Jul 07 18:52:39.947209 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:39.947185    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr" podUID="69a93ad7-7f92-407e-a5ec-8ddbd9d53216" containerName="manager" containerID="cri-o://0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991" gracePeriod=10
Jul 07 18:52:40.187366 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.187343    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:40.235390 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.235354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-extensions-socket-volume\") pod \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") "
Jul 07 18:52:40.235390 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.235406    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t462s\" (UniqueName: \"kubernetes.io/projected/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-kube-api-access-t462s\") pod \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\" (UID: \"69a93ad7-7f92-407e-a5ec-8ddbd9d53216\") "
Jul 07 18:52:40.235685 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.235665    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "69a93ad7-7f92-407e-a5ec-8ddbd9d53216" (UID: "69a93ad7-7f92-407e-a5ec-8ddbd9d53216"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:52:40.237393 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.237370    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-kube-api-access-t462s" (OuterVolumeSpecName: "kube-api-access-t462s") pod "69a93ad7-7f92-407e-a5ec-8ddbd9d53216" (UID: "69a93ad7-7f92-407e-a5ec-8ddbd9d53216"). InnerVolumeSpecName "kube-api-access-t462s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:40.336157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.336116    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-extensions-socket-volume\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:40.336157 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.336154    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t462s\" (UniqueName: \"kubernetes.io/projected/69a93ad7-7f92-407e-a5ec-8ddbd9d53216-kube-api-access-t462s\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:52:40.933421 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.933387    2581 generic.go:356] "Generic (PLEG): container finished" podID="69a93ad7-7f92-407e-a5ec-8ddbd9d53216" containerID="0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991" exitCode=0
Jul 07 18:52:40.933798 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.933431    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"
Jul 07 18:52:40.933798 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.933437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr" event={"ID":"69a93ad7-7f92-407e-a5ec-8ddbd9d53216","Type":"ContainerDied","Data":"0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991"}
Jul 07 18:52:40.933798 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.933490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr" event={"ID":"69a93ad7-7f92-407e-a5ec-8ddbd9d53216","Type":"ContainerDied","Data":"31329e57c1eb2f84a2c8939830338e6d48126837cb0e84a15b861329cf4d9d29"}
Jul 07 18:52:40.933798 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.933518    2581 scope.go:117] "RemoveContainer" containerID="0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991"
Jul 07 18:52:40.941462 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.941437    2581 scope.go:117] "RemoveContainer" containerID="0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991"
Jul 07 18:52:40.941732 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:52:40.941710    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991\": container with ID starting with 0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991 not found: ID does not exist" containerID="0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991"
Jul 07 18:52:40.941790 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.941740    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991"} err="failed to get container status \"0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991\": rpc error: code = NotFound desc = could not find container \"0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991\": container with ID starting with 0cbe8a7cfd46401ebe3413488d3f40a4e9b8ed293f056dd2233ddae457739991 not found: ID does not exist"
Jul 07 18:52:40.960700 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.960678    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"]
Jul 07 18:52:40.971520 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:40.971497    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ms2lr"]
Jul 07 18:52:41.945412 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:52:41.945381    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a93ad7-7f92-407e-a5ec-8ddbd9d53216" path="/var/lib/kubelet/pods/69a93ad7-7f92-407e-a5ec-8ddbd9d53216/volumes"
Jul 07 18:53:04.008551 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.008474    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"]
Jul 07 18:53:04.008984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.008717    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a93ad7-7f92-407e-a5ec-8ddbd9d53216" containerName="manager"
Jul 07 18:53:04.008984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.008729    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a93ad7-7f92-407e-a5ec-8ddbd9d53216" containerName="manager"
Jul 07 18:53:04.008984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.008776    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a93ad7-7f92-407e-a5ec-8ddbd9d53216" containerName="manager"
Jul 07 18:53:04.011437 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.011421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.013702 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.013685    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-95977\""
Jul 07 18:53:04.013770 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.013687    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 18:53:04.020288 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.020267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"]
Jul 07 18:53:04.102533 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.102502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"]
Jul 07 18:53:04.117424 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.117399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8vlj\" (UniqueName: \"kubernetes.io/projected/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-kube-api-access-v8vlj\") pod \"limitador-limitador-64c94fd64f-t6nnf\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.117560 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.117455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-config-file\") pod \"limitador-limitador-64c94fd64f-t6nnf\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.218441 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.218405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8vlj\" (UniqueName: \"kubernetes.io/projected/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-kube-api-access-v8vlj\") pod \"limitador-limitador-64c94fd64f-t6nnf\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.218618 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.218487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-config-file\") pod \"limitador-limitador-64c94fd64f-t6nnf\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.219074 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.219050    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-config-file\") pod \"limitador-limitador-64c94fd64f-t6nnf\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.231392 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.231362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8vlj\" (UniqueName: \"kubernetes.io/projected/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-kube-api-access-v8vlj\") pod \"limitador-limitador-64c94fd64f-t6nnf\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.322338 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.322274    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:04.402825 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.402783    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:53:04.409104 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.409073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.426827 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.426794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:53:04.463545 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.463503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"]
Jul 07 18:53:04.465693 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:53:04.465669    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e206b5a_6633_42f7_8c95_9b7fda9fb4f0.slice/crio-db78de6124f3f8352eb97f1006ac87f0c31e514a6b6f774cd1a159dfa467a418 WatchSource:0}: Error finding container db78de6124f3f8352eb97f1006ac87f0c31e514a6b6f774cd1a159dfa467a418: Status 404 returned error can't find the container with id db78de6124f3f8352eb97f1006ac87f0c31e514a6b6f774cd1a159dfa467a418
Jul 07 18:53:04.474608 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.474589    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:53:04.520614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.520583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knpdv\" (UniqueName: \"kubernetes.io/projected/10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5-kube-api-access-knpdv\") pod \"limitador-limitador-54d6d988d5-tp6qp\" (UID: \"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.520614 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.520615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5-config-file\") pod \"limitador-limitador-54d6d988d5-tp6qp\" (UID: \"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.621915 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.621836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knpdv\" (UniqueName: \"kubernetes.io/projected/10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5-kube-api-access-knpdv\") pod \"limitador-limitador-54d6d988d5-tp6qp\" (UID: \"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.621915 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.621892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5-config-file\") pod \"limitador-limitador-54d6d988d5-tp6qp\" (UID: \"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.622561 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.622541    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5-config-file\") pod \"limitador-limitador-54d6d988d5-tp6qp\" (UID: \"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.635491 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.635466    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knpdv\" (UniqueName: \"kubernetes.io/projected/10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5-kube-api-access-knpdv\") pod \"limitador-limitador-54d6d988d5-tp6qp\" (UID: \"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.722467 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.722440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:04.854438 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.854416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:53:04.856778 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:53:04.856753    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f7e2d0_0d3e_43c1_8645_1d59a8e66ca5.slice/crio-cce04326d69f7d6a3b088cb8d8f4df77943ac5497f1b7edd2cf75a2afe1d2bd4 WatchSource:0}: Error finding container cce04326d69f7d6a3b088cb8d8f4df77943ac5497f1b7edd2cf75a2afe1d2bd4: Status 404 returned error can't find the container with id cce04326d69f7d6a3b088cb8d8f4df77943ac5497f1b7edd2cf75a2afe1d2bd4
Jul 07 18:53:04.903553 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.903494    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-87svz"]
Jul 07 18:53:04.907885 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.907866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-87svz"
Jul 07 18:53:04.910074 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.910058    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v8gnw\""
Jul 07 18:53:04.917336 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:04.917316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-87svz"]
Jul 07 18:53:05.025674 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:05.025645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbqps\" (UniqueName: \"kubernetes.io/projected/7b19cbbe-c2de-4068-b0f3-fef38ee5fe20-kube-api-access-fbqps\") pod \"authorino-58cd955675-87svz\" (UID: \"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20\") " pod="kuadrant-system/authorino-58cd955675-87svz"
Jul 07 18:53:05.029971 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:05.029940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf" event={"ID":"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0","Type":"ContainerStarted","Data":"db78de6124f3f8352eb97f1006ac87f0c31e514a6b6f774cd1a159dfa467a418"}
Jul 07 18:53:05.031043 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:05.031010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp" event={"ID":"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5","Type":"ContainerStarted","Data":"cce04326d69f7d6a3b088cb8d8f4df77943ac5497f1b7edd2cf75a2afe1d2bd4"}
Jul 07 18:53:05.126637 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:05.126589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbqps\" (UniqueName: \"kubernetes.io/projected/7b19cbbe-c2de-4068-b0f3-fef38ee5fe20-kube-api-access-fbqps\") pod \"authorino-58cd955675-87svz\" (UID: \"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20\") " pod="kuadrant-system/authorino-58cd955675-87svz"
Jul 07 18:53:05.137151 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:05.137125    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbqps\" (UniqueName: \"kubernetes.io/projected/7b19cbbe-c2de-4068-b0f3-fef38ee5fe20-kube-api-access-fbqps\") pod \"authorino-58cd955675-87svz\" (UID: \"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20\") " pod="kuadrant-system/authorino-58cd955675-87svz"
Jul 07 18:53:05.216373 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:05.216288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-87svz"
Jul 07 18:53:05.364359 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:05.364276    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-87svz"]
Jul 07 18:53:05.369467 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:53:05.369438    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b19cbbe_c2de_4068_b0f3_fef38ee5fe20.slice/crio-fbec5aadaeb6f50177a30d50047c051576da13bf44af7c197bbef6bc427b0d72 WatchSource:0}: Error finding container fbec5aadaeb6f50177a30d50047c051576da13bf44af7c197bbef6bc427b0d72: Status 404 returned error can't find the container with id fbec5aadaeb6f50177a30d50047c051576da13bf44af7c197bbef6bc427b0d72
Jul 07 18:53:06.038370 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:06.038221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-87svz" event={"ID":"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20","Type":"ContainerStarted","Data":"fbec5aadaeb6f50177a30d50047c051576da13bf44af7c197bbef6bc427b0d72"}
Jul 07 18:53:09.078304 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:09.078264    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-87svz"]
Jul 07 18:53:10.061984 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.061944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-87svz" event={"ID":"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20","Type":"ContainerStarted","Data":"61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e"}
Jul 07 18:53:10.062162 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.062006    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-87svz" podUID="7b19cbbe-c2de-4068-b0f3-fef38ee5fe20" containerName="authorino" containerID="cri-o://61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e" gracePeriod=30
Jul 07 18:53:10.063408 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.063379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf" event={"ID":"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0","Type":"ContainerStarted","Data":"0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5"}
Jul 07 18:53:10.063539 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.063442    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:10.064993 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.064921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp" event={"ID":"10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5","Type":"ContainerStarted","Data":"dfcebadac0befa3bdf9225d46c2449adab2b6403cdddc723d9dab1e7cafb62d7"}
Jul 07 18:53:10.065281 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.065091    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:10.086651 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.086602    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-87svz" podStartSLOduration=1.883002173 podStartE2EDuration="6.086583477s" totalImagesPullingTime="4.203581304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:53:10.086048199 +0000 UTC m=+540.639939685" watchObservedRunningTime="2026-07-07 18:53:10.086583477 +0000 UTC m=+540.640474965"
Jul 07 18:53:10.131216 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.131170    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp" podStartSLOduration=1.414278672 podStartE2EDuration="6.131156343s" totalImagesPullingTime="4.716877671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:53:10.107730687 +0000 UTC m=+540.661622173" watchObservedRunningTime="2026-07-07 18:53:10.131156343 +0000 UTC m=+540.685047830"
Jul 07 18:53:10.131685 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.131660    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf" podStartSLOduration=2.016908749 podStartE2EDuration="7.13165173s" totalImagesPullingTime="5.114742981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:53:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:53:10.128945235 +0000 UTC m=+540.682836722" watchObservedRunningTime="2026-07-07 18:53:10.13165173 +0000 UTC m=+540.685543216"
Jul 07 18:53:10.306101 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.306076    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-87svz"
Jul 07 18:53:10.473744 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.473715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbqps\" (UniqueName: \"kubernetes.io/projected/7b19cbbe-c2de-4068-b0f3-fef38ee5fe20-kube-api-access-fbqps\") pod \"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20\" (UID: \"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20\") "
Jul 07 18:53:10.475775 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.475742    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b19cbbe-c2de-4068-b0f3-fef38ee5fe20-kube-api-access-fbqps" (OuterVolumeSpecName: "kube-api-access-fbqps") pod "7b19cbbe-c2de-4068-b0f3-fef38ee5fe20" (UID: "7b19cbbe-c2de-4068-b0f3-fef38ee5fe20"). InnerVolumeSpecName "kube-api-access-fbqps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:53:10.574203 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:10.574172    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbqps\" (UniqueName: \"kubernetes.io/projected/7b19cbbe-c2de-4068-b0f3-fef38ee5fe20-kube-api-access-fbqps\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:53:11.070553 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.070522    2581 generic.go:356] "Generic (PLEG): container finished" podID="7b19cbbe-c2de-4068-b0f3-fef38ee5fe20" containerID="61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e" exitCode=0
Jul 07 18:53:11.070731 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.070562    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-87svz"
Jul 07 18:53:11.070731 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.070600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-87svz" event={"ID":"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20","Type":"ContainerDied","Data":"61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e"}
Jul 07 18:53:11.070731 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.070627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-87svz" event={"ID":"7b19cbbe-c2de-4068-b0f3-fef38ee5fe20","Type":"ContainerDied","Data":"fbec5aadaeb6f50177a30d50047c051576da13bf44af7c197bbef6bc427b0d72"}
Jul 07 18:53:11.070731 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.070643    2581 scope.go:117] "RemoveContainer" containerID="61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e"
Jul 07 18:53:11.079548 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.079523    2581 scope.go:117] "RemoveContainer" containerID="61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e"
Jul 07 18:53:11.079803 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:53:11.079786    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e\": container with ID starting with 61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e not found: ID does not exist" containerID="61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e"
Jul 07 18:53:11.079848 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.079814    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e"} err="failed to get container status \"61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e\": rpc error: code = NotFound desc = could not find container \"61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e\": container with ID starting with 61c7008847b729cf2f304367c9609037575055cdeba7976fd26c577f4366e69e not found: ID does not exist"
Jul 07 18:53:11.112275 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.112238    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-87svz"]
Jul 07 18:53:11.124031 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.124012    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-87svz"]
Jul 07 18:53:11.945678 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:11.945649    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b19cbbe-c2de-4068-b0f3-fef38ee5fe20" path="/var/lib/kubelet/pods/7b19cbbe-c2de-4068-b0f3-fef38ee5fe20/volumes"
Jul 07 18:53:21.072091 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.072055    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"
Jul 07 18:53:21.072505 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.072145    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:21.153235 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.153204    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"]
Jul 07 18:53:21.153421 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.153400    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf" podUID="3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" containerName="limitador" containerID="cri-o://0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5" gracePeriod=30
Jul 07 18:53:21.690944 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.690921    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:21.852234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.852202    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-config-file\") pod \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") "
Jul 07 18:53:21.852409 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.852308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8vlj\" (UniqueName: \"kubernetes.io/projected/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-kube-api-access-v8vlj\") pod \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\" (UID: \"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0\") "
Jul 07 18:53:21.852606 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.852580    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-config-file" (OuterVolumeSpecName: "config-file") pod "3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" (UID: "3e206b5a-6633-42f7-8c95-9b7fda9fb4f0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:53:21.854305 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.854284    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-kube-api-access-v8vlj" (OuterVolumeSpecName: "kube-api-access-v8vlj") pod "3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" (UID: "3e206b5a-6633-42f7-8c95-9b7fda9fb4f0"). InnerVolumeSpecName "kube-api-access-v8vlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:53:21.953698 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.953670    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8vlj\" (UniqueName: \"kubernetes.io/projected/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-kube-api-access-v8vlj\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:53:21.953698 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:21.953693    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0-config-file\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:53:22.114265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.114170    2581 generic.go:356] "Generic (PLEG): container finished" podID="3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" containerID="0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5" exitCode=0
Jul 07 18:53:22.114265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.114229    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"
Jul 07 18:53:22.114265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.114239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf" event={"ID":"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0","Type":"ContainerDied","Data":"0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5"}
Jul 07 18:53:22.114727 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.114305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t6nnf" event={"ID":"3e206b5a-6633-42f7-8c95-9b7fda9fb4f0","Type":"ContainerDied","Data":"db78de6124f3f8352eb97f1006ac87f0c31e514a6b6f774cd1a159dfa467a418"}
Jul 07 18:53:22.114727 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.114330    2581 scope.go:117] "RemoveContainer" containerID="0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5"
Jul 07 18:53:22.122430 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.122414    2581 scope.go:117] "RemoveContainer" containerID="0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5"
Jul 07 18:53:22.122658 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:53:22.122640    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5\": container with ID starting with 0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5 not found: ID does not exist" containerID="0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5"
Jul 07 18:53:22.122714 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.122664    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5"} err="failed to get container status \"0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5\": rpc error: code = NotFound desc = could not find container \"0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5\": container with ID starting with 0558e6c7acb82216e8b51d638cc9e0983c3838d024095f6a2f54b823788975f5 not found: ID does not exist"
Jul 07 18:53:22.133042 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.133017    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"]
Jul 07 18:53:22.138323 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:22.138303    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t6nnf"]
Jul 07 18:53:23.502121 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.502085    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-c8979"]
Jul 07 18:53:23.502572 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.502472    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b19cbbe-c2de-4068-b0f3-fef38ee5fe20" containerName="authorino"
Jul 07 18:53:23.502572 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.502491    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b19cbbe-c2de-4068-b0f3-fef38ee5fe20" containerName="authorino"
Jul 07 18:53:23.502572 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.502505    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" containerName="limitador"
Jul 07 18:53:23.502572 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.502513    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" containerName="limitador"
Jul 07 18:53:23.502793 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.502594    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" containerName="limitador"
Jul 07 18:53:23.502793 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.502605    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b19cbbe-c2de-4068-b0f3-fef38ee5fe20" containerName="authorino"
Jul 07 18:53:23.506718 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.506695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.509359 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.509336    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vq5ks\""
Jul 07 18:53:23.509482 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.509468    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 18:53:23.515183 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.515161    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c8979"]
Jul 07 18:53:23.666068 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.666035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8c052fe2-7bca-461b-a18c-c64c26b8d58c-data\") pod \"postgres-69fb4594cf-c8979\" (UID: \"8c052fe2-7bca-461b-a18c-c64c26b8d58c\") " pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.666244 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.666080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w487h\" (UniqueName: \"kubernetes.io/projected/8c052fe2-7bca-461b-a18c-c64c26b8d58c-kube-api-access-w487h\") pod \"postgres-69fb4594cf-c8979\" (UID: \"8c052fe2-7bca-461b-a18c-c64c26b8d58c\") " pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.766790 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.766723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8c052fe2-7bca-461b-a18c-c64c26b8d58c-data\") pod \"postgres-69fb4594cf-c8979\" (UID: \"8c052fe2-7bca-461b-a18c-c64c26b8d58c\") " pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.766790 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.766763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w487h\" (UniqueName: \"kubernetes.io/projected/8c052fe2-7bca-461b-a18c-c64c26b8d58c-kube-api-access-w487h\") pod \"postgres-69fb4594cf-c8979\" (UID: \"8c052fe2-7bca-461b-a18c-c64c26b8d58c\") " pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.767109 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.767087    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8c052fe2-7bca-461b-a18c-c64c26b8d58c-data\") pod \"postgres-69fb4594cf-c8979\" (UID: \"8c052fe2-7bca-461b-a18c-c64c26b8d58c\") " pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.779376 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.779347    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w487h\" (UniqueName: \"kubernetes.io/projected/8c052fe2-7bca-461b-a18c-c64c26b8d58c-kube-api-access-w487h\") pod \"postgres-69fb4594cf-c8979\" (UID: \"8c052fe2-7bca-461b-a18c-c64c26b8d58c\") " pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.817172 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.817138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:23.945655 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.945628    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e206b5a-6633-42f7-8c95-9b7fda9fb4f0" path="/var/lib/kubelet/pods/3e206b5a-6633-42f7-8c95-9b7fda9fb4f0/volumes"
Jul 07 18:53:23.961489 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:23.961417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c8979"]
Jul 07 18:53:23.964161 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:53:23.964135    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c052fe2_7bca_461b_a18c_c64c26b8d58c.slice/crio-7f61aebe9155be16d41454805fabbd99ed3c6c81028f8dcd139050455db0acf2 WatchSource:0}: Error finding container 7f61aebe9155be16d41454805fabbd99ed3c6c81028f8dcd139050455db0acf2: Status 404 returned error can't find the container with id 7f61aebe9155be16d41454805fabbd99ed3c6c81028f8dcd139050455db0acf2
Jul 07 18:53:24.125112 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:24.125036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c8979" event={"ID":"8c052fe2-7bca-461b-a18c-c64c26b8d58c","Type":"ContainerStarted","Data":"7f61aebe9155be16d41454805fabbd99ed3c6c81028f8dcd139050455db0acf2"}
Jul 07 18:53:56.254738 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:56.254694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c8979" event={"ID":"8c052fe2-7bca-461b-a18c-c64c26b8d58c","Type":"ContainerStarted","Data":"026b16e0bc702953b368e5c8504d7785a62d147e51f326d9ff83011c05b03438"}
Jul 07 18:53:56.255147 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:56.254804    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:53:56.281305 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:53:56.281228    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-c8979" podStartSLOduration=1.103922449 podStartE2EDuration="33.281207833s" totalImagesPullingTime="32.177285384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:53:56.279469433 +0000 UTC m=+586.833360920" watchObservedRunningTime="2026-07-07 18:53:56.281207833 +0000 UTC m=+586.835099320"
Jul 07 18:54:02.287813 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:02.287782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-c8979"
Jul 07 18:54:02.846859 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:02.846829    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrvpw"]
Jul 07 18:54:02.864356 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:02.864333    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrvpw"]
Jul 07 18:54:02.864542 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:02.864415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrvpw"
Jul 07 18:54:02.866833 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:02.866807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v8gnw\""
Jul 07 18:54:02.965702 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:02.965669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z6pw\" (UniqueName: \"kubernetes.io/projected/5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2-kube-api-access-9z6pw\") pod \"authorino-5d4b67c446-mrvpw\" (UID: \"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2\") " pod="kuadrant-system/authorino-5d4b67c446-mrvpw"
Jul 07 18:54:03.066921 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.066894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z6pw\" (UniqueName: \"kubernetes.io/projected/5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2-kube-api-access-9z6pw\") pod \"authorino-5d4b67c446-mrvpw\" (UID: \"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2\") " pod="kuadrant-system/authorino-5d4b67c446-mrvpw"
Jul 07 18:54:03.080090 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.080063    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z6pw\" (UniqueName: \"kubernetes.io/projected/5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2-kube-api-access-9z6pw\") pod \"authorino-5d4b67c446-mrvpw\" (UID: \"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2\") " pod="kuadrant-system/authorino-5d4b67c446-mrvpw"
Jul 07 18:54:03.107959 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.107899    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrvpw"]
Jul 07 18:54:03.108088 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.108077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrvpw"
Jul 07 18:54:03.144479 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.144451    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cd95c967b-tvmjk"]
Jul 07 18:54:03.148317 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.148294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd95c967b-tvmjk"
Jul 07 18:54:03.160684 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.160634    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd95c967b-tvmjk"]
Jul 07 18:54:03.242034 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.241896    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrvpw"]
Jul 07 18:54:03.244717 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:54:03.244685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ca8ac44_14cb_4796_bcfc_ea3bf1480bb2.slice/crio-035de7e74448f7c8a08f563f2e7a32a47c7c8b0900d20b9ca57ad6e10f9cbc06 WatchSource:0}: Error finding container 035de7e74448f7c8a08f563f2e7a32a47c7c8b0900d20b9ca57ad6e10f9cbc06: Status 404 returned error can't find the container with id 035de7e74448f7c8a08f563f2e7a32a47c7c8b0900d20b9ca57ad6e10f9cbc06
Jul 07 18:54:03.256301 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.256278    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd95c967b-tvmjk"]
Jul 07 18:54:03.256521 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:54:03.256499    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-k9wpf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-cd95c967b-tvmjk" podUID="820aa9c8-63dd-4a34-8f51-a08a5d276825"
Jul 07 18:54:03.268104 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.268084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wpf\" (UniqueName: \"kubernetes.io/projected/820aa9c8-63dd-4a34-8f51-a08a5d276825-kube-api-access-k9wpf\") pod \"authorino-cd95c967b-tvmjk\" (UID: \"820aa9c8-63dd-4a34-8f51-a08a5d276825\") " pod="kuadrant-system/authorino-cd95c967b-tvmjk"
Jul 07 18:54:03.282447 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.282421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd95c967b-tvmjk"
Jul 07 18:54:03.282447 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.282434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mrvpw" event={"ID":"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2","Type":"ContainerStarted","Data":"035de7e74448f7c8a08f563f2e7a32a47c7c8b0900d20b9ca57ad6e10f9cbc06"}
Jul 07 18:54:03.289426 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.289404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd95c967b-tvmjk"
Jul 07 18:54:03.297834 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.297812    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b4bd9c7b8-th6ht"]
Jul 07 18:54:03.300868 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.300850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.304015 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.304000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 18:54:03.318138 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.318118    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b4bd9c7b8-th6ht"]
Jul 07 18:54:03.368489 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.368413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wpf\" (UniqueName: \"kubernetes.io/projected/820aa9c8-63dd-4a34-8f51-a08a5d276825-kube-api-access-k9wpf\") pod \"authorino-cd95c967b-tvmjk\" (UID: \"820aa9c8-63dd-4a34-8f51-a08a5d276825\") " pod="kuadrant-system/authorino-cd95c967b-tvmjk"
Jul 07 18:54:03.368489 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.368460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb3a33b7-c96b-478f-a678-67aaab324fb8-tls-cert\") pod \"authorino-5b4bd9c7b8-th6ht\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") " pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.368751 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.368491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hx9h\" (UniqueName: \"kubernetes.io/projected/fb3a33b7-c96b-478f-a678-67aaab324fb8-kube-api-access-6hx9h\") pod \"authorino-5b4bd9c7b8-th6ht\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") " pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.380039 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.380009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wpf\" (UniqueName: \"kubernetes.io/projected/820aa9c8-63dd-4a34-8f51-a08a5d276825-kube-api-access-k9wpf\") pod \"authorino-cd95c967b-tvmjk\" (UID: \"820aa9c8-63dd-4a34-8f51-a08a5d276825\") " pod="kuadrant-system/authorino-cd95c967b-tvmjk"
Jul 07 18:54:03.469105 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.469072    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9wpf\" (UniqueName: \"kubernetes.io/projected/820aa9c8-63dd-4a34-8f51-a08a5d276825-kube-api-access-k9wpf\") pod \"820aa9c8-63dd-4a34-8f51-a08a5d276825\" (UID: \"820aa9c8-63dd-4a34-8f51-a08a5d276825\") "
Jul 07 18:54:03.469311 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.469291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb3a33b7-c96b-478f-a678-67aaab324fb8-tls-cert\") pod \"authorino-5b4bd9c7b8-th6ht\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") " pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.469392 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.469347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hx9h\" (UniqueName: \"kubernetes.io/projected/fb3a33b7-c96b-478f-a678-67aaab324fb8-kube-api-access-6hx9h\") pod \"authorino-5b4bd9c7b8-th6ht\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") " pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.471185 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.471152    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820aa9c8-63dd-4a34-8f51-a08a5d276825-kube-api-access-k9wpf" (OuterVolumeSpecName: "kube-api-access-k9wpf") pod "820aa9c8-63dd-4a34-8f51-a08a5d276825" (UID: "820aa9c8-63dd-4a34-8f51-a08a5d276825"). InnerVolumeSpecName "kube-api-access-k9wpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:54:03.471625 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.471607    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb3a33b7-c96b-478f-a678-67aaab324fb8-tls-cert\") pod \"authorino-5b4bd9c7b8-th6ht\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") " pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.479090 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.479072    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hx9h\" (UniqueName: \"kubernetes.io/projected/fb3a33b7-c96b-478f-a678-67aaab324fb8-kube-api-access-6hx9h\") pod \"authorino-5b4bd9c7b8-th6ht\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") " pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.570265 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.570232    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9wpf\" (UniqueName: \"kubernetes.io/projected/820aa9c8-63dd-4a34-8f51-a08a5d276825-kube-api-access-k9wpf\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:54:03.609232 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.609208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:54:03.743879 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:03.743849    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b4bd9c7b8-th6ht"]
Jul 07 18:54:03.747235 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:54:03.747207    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb3a33b7_c96b_478f_a678_67aaab324fb8.slice/crio-d249bf9f68014caacc87ac46dcdf39057f08bc269d9f670af1cd45a6722a8737 WatchSource:0}: Error finding container d249bf9f68014caacc87ac46dcdf39057f08bc269d9f670af1cd45a6722a8737: Status 404 returned error can't find the container with id d249bf9f68014caacc87ac46dcdf39057f08bc269d9f670af1cd45a6722a8737
Jul 07 18:54:04.288189 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.288140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mrvpw" event={"ID":"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2","Type":"ContainerStarted","Data":"a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34"}
Jul 07 18:54:04.288542 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.288507    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-mrvpw" podUID="5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2" containerName="authorino" containerID="cri-o://a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34" gracePeriod=30
Jul 07 18:54:04.289913 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.289890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd95c967b-tvmjk"
Jul 07 18:54:04.290331 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.289890    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht" event={"ID":"fb3a33b7-c96b-478f-a678-67aaab324fb8","Type":"ContainerStarted","Data":"3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948"}
Jul 07 18:54:04.290331 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.289959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht" event={"ID":"fb3a33b7-c96b-478f-a678-67aaab324fb8","Type":"ContainerStarted","Data":"d249bf9f68014caacc87ac46dcdf39057f08bc269d9f670af1cd45a6722a8737"}
Jul 07 18:54:04.311995 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.311954    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-mrvpw" podStartSLOduration=1.938715067 podStartE2EDuration="2.311940413s" totalImagesPullingTime="373.225346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:04.310033147 +0000 UTC m=+594.863924634" watchObservedRunningTime="2026-07-07 18:54:04.311940413 +0000 UTC m=+594.865831898"
Jul 07 18:54:04.339457 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.339425    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd95c967b-tvmjk"]
Jul 07 18:54:04.344926 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.344900    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cd95c967b-tvmjk"]
Jul 07 18:54:04.360816 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.360777    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht" podStartSLOduration=0.96596558 podStartE2EDuration="1.360760493s" totalImagesPullingTime="394.794913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:04.359843885 +0000 UTC m=+594.913735367" watchObservedRunningTime="2026-07-07 18:54:04.360760493 +0000 UTC m=+594.914651979"
Jul 07 18:54:04.515453 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.515431    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrvpw"
Jul 07 18:54:04.579095 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.579017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z6pw\" (UniqueName: \"kubernetes.io/projected/5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2-kube-api-access-9z6pw\") pod \"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2\" (UID: \"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2\") "
Jul 07 18:54:04.580955 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.580934    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2-kube-api-access-9z6pw" (OuterVolumeSpecName: "kube-api-access-9z6pw") pod "5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2" (UID: "5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2"). InnerVolumeSpecName "kube-api-access-9z6pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:54:04.680435 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:04.680401    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z6pw\" (UniqueName: \"kubernetes.io/projected/5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2-kube-api-access-9z6pw\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:54:05.295153 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.295121    2581 generic.go:356] "Generic (PLEG): container finished" podID="5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2" containerID="a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34" exitCode=0
Jul 07 18:54:05.295594 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.295160    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrvpw"
Jul 07 18:54:05.295594 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.295194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mrvpw" event={"ID":"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2","Type":"ContainerDied","Data":"a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34"}
Jul 07 18:54:05.295594 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.295223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mrvpw" event={"ID":"5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2","Type":"ContainerDied","Data":"035de7e74448f7c8a08f563f2e7a32a47c7c8b0900d20b9ca57ad6e10f9cbc06"}
Jul 07 18:54:05.295594 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.295239    2581 scope.go:117] "RemoveContainer" containerID="a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34"
Jul 07 18:54:05.306060 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.306042    2581 scope.go:117] "RemoveContainer" containerID="a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34"
Jul 07 18:54:05.306344 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:54:05.306319    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34\": container with ID starting with a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34 not found: ID does not exist" containerID="a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34"
Jul 07 18:54:05.306417 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.306353    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34"} err="failed to get container status \"a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34\": rpc error: code = NotFound desc = could not find container \"a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34\": container with ID starting with a04c0287a7b6198518e8b029d750af2049798034156b46dacd637262f606ea34 not found: ID does not exist"
Jul 07 18:54:05.321733 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.321712    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrvpw"]
Jul 07 18:54:05.328422 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.328396    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrvpw"]
Jul 07 18:54:05.945714 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.945673    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2" path="/var/lib/kubelet/pods/5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2/volumes"
Jul 07 18:54:05.946001 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:05.945989    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820aa9c8-63dd-4a34-8f51-a08a5d276825" path="/var/lib/kubelet/pods/820aa9c8-63dd-4a34-8f51-a08a5d276825/volumes"
Jul 07 18:54:45.933425 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:54:45.933344    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:55:08.753932 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:08.753902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:55:17.046518 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.046480    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"]
Jul 07 18:55:17.047012 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.046743    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2" containerName="authorino"
Jul 07 18:55:17.047012 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.046754    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2" containerName="authorino"
Jul 07 18:55:17.047012 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.046814    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ca8ac44-14cb-4796-bcfc-ea3bf1480bb2" containerName="authorino"
Jul 07 18:55:17.049703 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.049678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.053471 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.053449    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 18:55:17.053592 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.053450    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pblp2\""
Jul 07 18:55:17.053592 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.053481    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 18:55:17.053592 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.053493    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 18:55:17.072884 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.072857    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"]
Jul 07 18:55:17.130774 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.130737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.130774 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.130775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4zc\" (UniqueName: \"kubernetes.io/projected/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-kube-api-access-xz4zc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.130966 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.130798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.130966 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.130877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.130966 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.130909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.130966 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.130933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231508 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231508 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4zc\" (UniqueName: \"kubernetes.io/projected/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-kube-api-access-xz4zc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231713 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231713 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231713 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231713 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231956 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231934    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231999 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231979    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.231999 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.231994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.233851 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.233829    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.234124 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.234107    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.242897 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.242870    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4zc\" (UniqueName: \"kubernetes.io/projected/817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f-kube-api-access-xz4zc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t4lzz\" (UID: \"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.360420 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.360329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:17.491558 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.491524    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"]
Jul 07 18:55:17.495191 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:55:17.495165    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817be2d8_a3ac_4ddd_84f5_a7e3ebd7479f.slice/crio-0d5e9aad912391a3c8a2e6bb33e818bc190042f43ce07fa58c967ae4498b9ead WatchSource:0}: Error finding container 0d5e9aad912391a3c8a2e6bb33e818bc190042f43ce07fa58c967ae4498b9ead: Status 404 returned error can't find the container with id 0d5e9aad912391a3c8a2e6bb33e818bc190042f43ce07fa58c967ae4498b9ead
Jul 07 18:55:17.496519 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.496502    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:55:17.589911 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.589879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz" event={"ID":"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f","Type":"ContainerStarted","Data":"0d5e9aad912391a3c8a2e6bb33e818bc190042f43ce07fa58c967ae4498b9ead"}
Jul 07 18:55:17.973054 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:17.973015    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:55:19.600605 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:19.600569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz" event={"ID":"817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f","Type":"ContainerStarted","Data":"b31c53a1fde3aca16ace92b698b080b258adb7a6284be661aa8db38c55d1c02e"}
Jul 07 18:55:19.634010 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:19.633960    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz" podStartSLOduration=1.5374484160000002 podStartE2EDuration="2.63394342s" totalImagesPullingTime="1.096495004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:19.632396454 +0000 UTC m=+670.186287942" watchObservedRunningTime="2026-07-07 18:55:19.63394342 +0000 UTC m=+670.187834906"
Jul 07 18:55:27.361431 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:27.361399    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:27.361843 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:27.361457    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:27.373605 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:27.373583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:27.643405 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:27.643330    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t4lzz"
Jul 07 18:55:32.590455 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:32.590408    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:55:39.677543 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:55:39.677506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:56:00.716142 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.716108    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"]
Jul 07 18:56:00.721914 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.721897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.726278 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.726237    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 18:56:00.734498 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.734471    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"]
Jul 07 18:56:00.792852 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.792821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.793029 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.792855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.793029 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.792888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msb6r\" (UniqueName: \"kubernetes.io/projected/7e168d5f-4049-4c8a-b75a-94a61d40707c-kube-api-access-msb6r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.793029 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.792970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e168d5f-4049-4c8a-b75a-94a61d40707c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.793029 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.792996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.793029 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.793016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.893919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.893881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.893919 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.893920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.894145 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.893944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb6r\" (UniqueName: \"kubernetes.io/projected/7e168d5f-4049-4c8a-b75a-94a61d40707c-kube-api-access-msb6r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.894145 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.893984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e168d5f-4049-4c8a-b75a-94a61d40707c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.894145 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.894000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.894145 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.894019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.894404 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.894352    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.894479 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.894458    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.894527 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.894478    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.896231 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.896211    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e168d5f-4049-4c8a-b75a-94a61d40707c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.896410 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.896394    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e168d5f-4049-4c8a-b75a-94a61d40707c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:00.904122 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:00.904096    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msb6r\" (UniqueName: \"kubernetes.io/projected/7e168d5f-4049-4c8a-b75a-94a61d40707c-kube-api-access-msb6r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lzzp5\" (UID: \"7e168d5f-4049-4c8a-b75a-94a61d40707c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:01.031369 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:01.031329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:01.165815 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:01.165792    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"]
Jul 07 18:56:01.167803 ip-10-0-135-133 kubenswrapper[2581]: W0707 18:56:01.167764    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e168d5f_4049_4c8a_b75a_94a61d40707c.slice/crio-929e152005663141fc78cbfd0434814071bb8348726494a2a5da93be305249f5 WatchSource:0}: Error finding container 929e152005663141fc78cbfd0434814071bb8348726494a2a5da93be305249f5: Status 404 returned error can't find the container with id 929e152005663141fc78cbfd0434814071bb8348726494a2a5da93be305249f5
Jul 07 18:56:01.772787 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:01.772756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5" event={"ID":"7e168d5f-4049-4c8a-b75a-94a61d40707c","Type":"ContainerStarted","Data":"bf204bf5ac28860d58cc36af71cea6f541c7c44ce1462c42a46f8a0946d96095"}
Jul 07 18:56:01.773206 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:01.772802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5" event={"ID":"7e168d5f-4049-4c8a-b75a-94a61d40707c","Type":"ContainerStarted","Data":"929e152005663141fc78cbfd0434814071bb8348726494a2a5da93be305249f5"}
Jul 07 18:56:01.794418 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:01.794369    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5" podStartSLOduration=1.5614155969999999 podStartE2EDuration="1.794335133s" totalImagesPullingTime="232.919536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:01.793459736 +0000 UTC m=+712.347351212" watchObservedRunningTime="2026-07-07 18:56:01.794335133 +0000 UTC m=+712.348226619"
Jul 07 18:56:02.787763 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:02.787676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:56:11.031840 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:11.031803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:11.032223 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:11.031860    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:11.044336 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:11.044309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:11.829998 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:11.829974    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lzzp5"
Jul 07 18:56:13.888136 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:13.888103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:56:55.209216 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.209179    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b4bd9c7b8-th6ht"]
Jul 07 18:56:55.210035 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.210000    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht" podUID="fb3a33b7-c96b-478f-a678-67aaab324fb8" containerName="authorino" containerID="cri-o://3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948" gracePeriod=30
Jul 07 18:56:55.468760 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.468696    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:56:55.633821 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.633780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hx9h\" (UniqueName: \"kubernetes.io/projected/fb3a33b7-c96b-478f-a678-67aaab324fb8-kube-api-access-6hx9h\") pod \"fb3a33b7-c96b-478f-a678-67aaab324fb8\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") "
Jul 07 18:56:55.633821 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.633821    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb3a33b7-c96b-478f-a678-67aaab324fb8-tls-cert\") pod \"fb3a33b7-c96b-478f-a678-67aaab324fb8\" (UID: \"fb3a33b7-c96b-478f-a678-67aaab324fb8\") "
Jul 07 18:56:55.635940 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.635910    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb3a33b7-c96b-478f-a678-67aaab324fb8-kube-api-access-6hx9h" (OuterVolumeSpecName: "kube-api-access-6hx9h") pod "fb3a33b7-c96b-478f-a678-67aaab324fb8" (UID: "fb3a33b7-c96b-478f-a678-67aaab324fb8"). InnerVolumeSpecName "kube-api-access-6hx9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:56:55.643168 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.643142    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb3a33b7-c96b-478f-a678-67aaab324fb8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fb3a33b7-c96b-478f-a678-67aaab324fb8" (UID: "fb3a33b7-c96b-478f-a678-67aaab324fb8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:56:55.734988 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.734959    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hx9h\" (UniqueName: \"kubernetes.io/projected/fb3a33b7-c96b-478f-a678-67aaab324fb8-kube-api-access-6hx9h\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:56:55.734988 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:55.734988    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb3a33b7-c96b-478f-a678-67aaab324fb8-tls-cert\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 18:56:56.003072 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.002977    2581 generic.go:356] "Generic (PLEG): container finished" podID="fb3a33b7-c96b-478f-a678-67aaab324fb8" containerID="3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948" exitCode=0
Jul 07 18:56:56.003072 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.003029    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht"
Jul 07 18:56:56.003072 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.003030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht" event={"ID":"fb3a33b7-c96b-478f-a678-67aaab324fb8","Type":"ContainerDied","Data":"3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948"}
Jul 07 18:56:56.003072 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.003076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4bd9c7b8-th6ht" event={"ID":"fb3a33b7-c96b-478f-a678-67aaab324fb8","Type":"ContainerDied","Data":"d249bf9f68014caacc87ac46dcdf39057f08bc269d9f670af1cd45a6722a8737"}
Jul 07 18:56:56.003426 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.003093    2581 scope.go:117] "RemoveContainer" containerID="3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948"
Jul 07 18:56:56.012234 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.012219    2581 scope.go:117] "RemoveContainer" containerID="3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948"
Jul 07 18:56:56.012585 ip-10-0-135-133 kubenswrapper[2581]: E0707 18:56:56.012554    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948\": container with ID starting with 3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948 not found: ID does not exist" containerID="3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948"
Jul 07 18:56:56.012683 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.012583    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948"} err="failed to get container status \"3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948\": rpc error: code = NotFound desc = could not find container \"3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948\": container with ID starting with 3df75413aa90bd5cc791a59765b8f1d01970c13a9b2d3c2ff27a4dfe65805948 not found: ID does not exist"
Jul 07 18:56:56.033173 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.033152    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b4bd9c7b8-th6ht"]
Jul 07 18:56:56.042791 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:56.040548    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b4bd9c7b8-th6ht"]
Jul 07 18:56:57.946879 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:56:57.946846    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb3a33b7-c96b-478f-a678-67aaab324fb8" path="/var/lib/kubelet/pods/fb3a33b7-c96b-478f-a678-67aaab324fb8/volumes"
Jul 07 18:57:22.994152 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:57:22.994114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:57:35.689985 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:57:35.689898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:57:44.384163 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:57:44.384128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:57:53.892351 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:57:53.892309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:58:03.887037 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:58:03.886997    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:58:31.112556 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:58:31.112522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:58:43.187383 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:58:43.187343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:59:18.584691 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:59:18.584659    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:59:25.509085 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:59:25.509041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:59:35.980482 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:59:35.980449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:59:41.786688 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:59:41.786654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 18:59:52.687016 ip-10-0-135-133 kubenswrapper[2581]: I0707 18:59:52.686983    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:00:00.167526 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.167482    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724180-sfhjb"]
Jul 07 19:00:00.168027 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.167924    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb3a33b7-c96b-478f-a678-67aaab324fb8" containerName="authorino"
Jul 07 19:00:00.168027 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.167943    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb3a33b7-c96b-478f-a678-67aaab324fb8" containerName="authorino"
Jul 07 19:00:00.168027 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.168019    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb3a33b7-c96b-478f-a678-67aaab324fb8" containerName="authorino"
Jul 07 19:00:00.170929 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.170908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb"
Jul 07 19:00:00.173531 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.173513    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:00:00.190292 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.190262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724180-sfhjb"]
Jul 07 19:00:00.339751 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.339708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm2pk\" (UniqueName: \"kubernetes.io/projected/5e37c959-d790-4f1f-a93c-0b6081550696-kube-api-access-hm2pk\") pod \"maas-api-key-cleanup-29724180-sfhjb\" (UID: \"5e37c959-d790-4f1f-a93c-0b6081550696\") " pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb"
Jul 07 19:00:00.440289 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.440189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm2pk\" (UniqueName: \"kubernetes.io/projected/5e37c959-d790-4f1f-a93c-0b6081550696-kube-api-access-hm2pk\") pod \"maas-api-key-cleanup-29724180-sfhjb\" (UID: \"5e37c959-d790-4f1f-a93c-0b6081550696\") " pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb"
Jul 07 19:00:00.449837 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.449807    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm2pk\" (UniqueName: \"kubernetes.io/projected/5e37c959-d790-4f1f-a93c-0b6081550696-kube-api-access-hm2pk\") pod \"maas-api-key-cleanup-29724180-sfhjb\" (UID: \"5e37c959-d790-4f1f-a93c-0b6081550696\") " pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb"
Jul 07 19:00:00.483795 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.483768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb"
Jul 07 19:00:00.615758 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.615727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724180-sfhjb"]
Jul 07 19:00:00.617819 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:00:00.617789    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e37c959_d790_4f1f_a93c_0b6081550696.slice/crio-b8267b2ea1749d04e35b2494c6fe023f2e63c9d18d8a2f1ded74669ede09f046 WatchSource:0}: Error finding container b8267b2ea1749d04e35b2494c6fe023f2e63c9d18d8a2f1ded74669ede09f046: Status 404 returned error can't find the container with id b8267b2ea1749d04e35b2494c6fe023f2e63c9d18d8a2f1ded74669ede09f046
Jul 07 19:00:00.741102 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:00.741071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb" event={"ID":"5e37c959-d790-4f1f-a93c-0b6081550696","Type":"ContainerStarted","Data":"b8267b2ea1749d04e35b2494c6fe023f2e63c9d18d8a2f1ded74669ede09f046"}
Jul 07 19:00:01.478321 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:01.478283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:00:05.765513 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:05.765482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb" event={"ID":"5e37c959-d790-4f1f-a93c-0b6081550696","Type":"ContainerStarted","Data":"916f55a21c8a16bad909cef51b789f0c8a4b8fac8fd3e1e2a32d2f79a3f49b3b"}
Jul 07 19:00:05.786429 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:05.786376    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb" podStartSLOduration=1.359964083 podStartE2EDuration="5.786359658s" totalImagesPullingTime="4.426395575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:00:05.784598593 +0000 UTC m=+956.338490078" watchObservedRunningTime="2026-07-07 19:00:05.786359658 +0000 UTC m=+956.340251143"
Jul 07 19:00:06.770963 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:06.770930    2581 generic.go:356] "Generic (PLEG): container finished" podID="5e37c959-d790-4f1f-a93c-0b6081550696" containerID="916f55a21c8a16bad909cef51b789f0c8a4b8fac8fd3e1e2a32d2f79a3f49b3b" exitCode=0
Jul 07 19:00:06.771380 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:06.771005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb" event={"ID":"5e37c959-d790-4f1f-a93c-0b6081550696","Type":"ContainerDied","Data":"916f55a21c8a16bad909cef51b789f0c8a4b8fac8fd3e1e2a32d2f79a3f49b3b"}
Jul 07 19:00:07.899741 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:07.899711    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb"
Jul 07 19:00:08.003768 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:08.003727    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm2pk\" (UniqueName: \"kubernetes.io/projected/5e37c959-d790-4f1f-a93c-0b6081550696-kube-api-access-hm2pk\") pod \"5e37c959-d790-4f1f-a93c-0b6081550696\" (UID: \"5e37c959-d790-4f1f-a93c-0b6081550696\") "
Jul 07 19:00:08.005977 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:08.005945    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e37c959-d790-4f1f-a93c-0b6081550696-kube-api-access-hm2pk" (OuterVolumeSpecName: "kube-api-access-hm2pk") pod "5e37c959-d790-4f1f-a93c-0b6081550696" (UID: "5e37c959-d790-4f1f-a93c-0b6081550696"). InnerVolumeSpecName "kube-api-access-hm2pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:00:08.105179 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:08.105074    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm2pk\" (UniqueName: \"kubernetes.io/projected/5e37c959-d790-4f1f-a93c-0b6081550696-kube-api-access-hm2pk\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:00:08.780301 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:08.780274    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb"
Jul 07 19:00:08.780301 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:08.780290    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-sfhjb" event={"ID":"5e37c959-d790-4f1f-a93c-0b6081550696","Type":"ContainerDied","Data":"b8267b2ea1749d04e35b2494c6fe023f2e63c9d18d8a2f1ded74669ede09f046"}
Jul 07 19:00:08.780493 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:08.780339    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8267b2ea1749d04e35b2494c6fe023f2e63c9d18d8a2f1ded74669ede09f046"
Jul 07 19:00:13.299292 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:13.299247    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:00:22.679308 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:22.679271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:00:48.886443 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:00:48.886406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:01:00.388890 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:01:00.388859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:01:24.686661 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:01:24.686626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:01:34.590396 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:01:34.590362    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:01:49.095189 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:01:49.095151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:01:57.395825 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:01:57.395790    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:02:08.490231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:08.490146    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:02:17.683858 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:17.683825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:02:26.178351 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:26.178309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:02:53.288578 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:53.288544    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"]
Jul 07 19:02:53.289070 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:53.288782    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7" podUID="0f442d87-9944-400b-b45c-969e9bdf0156" containerName="manager" containerID="cri-o://35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257" gracePeriod=10
Jul 07 19:02:55.631958 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:55.631934    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 19:02:55.634837 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:55.634817    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f442d87-9944-400b-b45c-969e9bdf0156-extensions-socket-volume\") pod \"0f442d87-9944-400b-b45c-969e9bdf0156\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") "
Jul 07 19:02:55.634940 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:55.634869    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc4bb\" (UniqueName: \"kubernetes.io/projected/0f442d87-9944-400b-b45c-969e9bdf0156-kube-api-access-bc4bb\") pod \"0f442d87-9944-400b-b45c-969e9bdf0156\" (UID: \"0f442d87-9944-400b-b45c-969e9bdf0156\") "
Jul 07 19:02:55.635166 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:55.635144    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f442d87-9944-400b-b45c-969e9bdf0156-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f442d87-9944-400b-b45c-969e9bdf0156" (UID: "0f442d87-9944-400b-b45c-969e9bdf0156"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:02:55.636883 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:55.636855    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f442d87-9944-400b-b45c-969e9bdf0156-kube-api-access-bc4bb" (OuterVolumeSpecName: "kube-api-access-bc4bb") pod "0f442d87-9944-400b-b45c-969e9bdf0156" (UID: "0f442d87-9944-400b-b45c-969e9bdf0156"). InnerVolumeSpecName "kube-api-access-bc4bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:02:55.735498 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:55.735469    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f442d87-9944-400b-b45c-969e9bdf0156-extensions-socket-volume\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:02:55.735498 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:55.735496    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc4bb\" (UniqueName: \"kubernetes.io/projected/0f442d87-9944-400b-b45c-969e9bdf0156-kube-api-access-bc4bb\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:02:56.477229 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.477196    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f442d87-9944-400b-b45c-969e9bdf0156" containerID="35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257" exitCode=0
Jul 07 19:02:56.477408 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.477236    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7" event={"ID":"0f442d87-9944-400b-b45c-969e9bdf0156","Type":"ContainerDied","Data":"35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257"}
Jul 07 19:02:56.477408 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.477240    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"
Jul 07 19:02:56.477408 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.477304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7" event={"ID":"0f442d87-9944-400b-b45c-969e9bdf0156","Type":"ContainerDied","Data":"14ed146c59b1a787f9eaae1225d6e5aff27c1cda4e5f13a46ac5048f35439b2c"}
Jul 07 19:02:56.477408 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.477328    2581 scope.go:117] "RemoveContainer" containerID="35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257"
Jul 07 19:02:56.486628 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.486604    2581 scope.go:117] "RemoveContainer" containerID="35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257"
Jul 07 19:02:56.486922 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:02:56.486903    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257\": container with ID starting with 35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257 not found: ID does not exist" containerID="35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257"
Jul 07 19:02:56.486988 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.486934    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257"} err="failed to get container status \"35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257\": rpc error: code = NotFound desc = could not find container \"35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257\": container with ID starting with 35f32fb7ef6b81bc32a0f11f47f0c04199908916ac6eccfc64f2afae56001257 not found: ID does not exist"
Jul 07 19:02:56.497610 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.497581    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"]
Jul 07 19:02:56.505352 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:56.505332    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-njrs7"]
Jul 07 19:02:57.945607 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:02:57.945578    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f442d87-9944-400b-b45c-969e9bdf0156" path="/var/lib/kubelet/pods/0f442d87-9944-400b-b45c-969e9bdf0156/volumes"
Jul 07 19:03:54.429393 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.429304    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"]
Jul 07 19:03:54.429971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.429716    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f442d87-9944-400b-b45c-969e9bdf0156" containerName="manager"
Jul 07 19:03:54.429971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.429735    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f442d87-9944-400b-b45c-969e9bdf0156" containerName="manager"
Jul 07 19:03:54.429971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.429750    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e37c959-d790-4f1f-a93c-0b6081550696" containerName="cleanup"
Jul 07 19:03:54.429971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.429759    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e37c959-d790-4f1f-a93c-0b6081550696" containerName="cleanup"
Jul 07 19:03:54.429971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.429836    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e37c959-d790-4f1f-a93c-0b6081550696" containerName="cleanup"
Jul 07 19:03:54.429971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.429850    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f442d87-9944-400b-b45c-969e9bdf0156" containerName="manager"
Jul 07 19:03:54.432814 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.432792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.435144 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.435125    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2bl8b\""
Jul 07 19:03:54.443991 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.443959    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"]
Jul 07 19:03:54.569925 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.569882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef4c40d3-e6a7-430a-99f7-6c5e2d49696a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bzss\" (UID: \"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.570119 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.569996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2dp4\" (UniqueName: \"kubernetes.io/projected/ef4c40d3-e6a7-430a-99f7-6c5e2d49696a-kube-api-access-l2dp4\") pod \"kuadrant-operator-controller-manager-86878c769f-6bzss\" (UID: \"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.671372 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.671329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2dp4\" (UniqueName: \"kubernetes.io/projected/ef4c40d3-e6a7-430a-99f7-6c5e2d49696a-kube-api-access-l2dp4\") pod \"kuadrant-operator-controller-manager-86878c769f-6bzss\" (UID: \"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.671546 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.671397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef4c40d3-e6a7-430a-99f7-6c5e2d49696a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bzss\" (UID: \"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.671800 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.671781    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef4c40d3-e6a7-430a-99f7-6c5e2d49696a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bzss\" (UID: \"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.680608 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.680556    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2dp4\" (UniqueName: \"kubernetes.io/projected/ef4c40d3-e6a7-430a-99f7-6c5e2d49696a-kube-api-access-l2dp4\") pod \"kuadrant-operator-controller-manager-86878c769f-6bzss\" (UID: \"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.742602 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.742570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:54.879492 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:54.879451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"]
Jul 07 19:03:55.718730 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:55.718691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss" event={"ID":"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a","Type":"ContainerStarted","Data":"066b6417ecb6b4309716cd20a457934a9dc8bec05fdec4d5ea81ea5120c2a5c0"}
Jul 07 19:03:55.719159 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:55.718757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss" event={"ID":"ef4c40d3-e6a7-430a-99f7-6c5e2d49696a","Type":"ContainerStarted","Data":"2d4400d0095c10b5f8410d73261d2737efd182575e9bd04665a5833ddf911efd"}
Jul 07 19:03:55.719159 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:55.718811    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:03:55.741756 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:03:55.741618    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss" podStartSLOduration=1.7415970490000001 podStartE2EDuration="1.741597049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:03:55.740646919 +0000 UTC m=+1186.294538406" watchObservedRunningTime="2026-07-07 19:03:55.741597049 +0000 UTC m=+1186.295488535"
Jul 07 19:04:06.724904 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:04:06.724871    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bzss"
Jul 07 19:04:14.390370 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:04:14.390335    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:04:25.387338 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:04:25.387305    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:04:36.275797 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:04:36.275761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:04:47.100505 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:04:47.100475    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:04:59.477283 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:04:59.477233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:05:08.075309 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:05:08.075270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:05:18.375772 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:05:18.375740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:05:27.873094 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:05:27.873061    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:05:37.977733 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:05:37.977704    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:05:45.679024 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:05:45.678986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:05:54.473290 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:05:54.473238    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:06:00.878636 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:06:00.878598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:06:23.074625 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:06:23.074590    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:06:31.880011 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:06:31.879978    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:06:41.670636 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:06:41.670554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:06:52.569765 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:06:52.569726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:07:20.572647 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:07:20.572612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:07:29.975813 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:07:29.975773    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:07:40.890353 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:07:40.890315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:07:49.605999 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:07:49.605958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:07:58.787081 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:07:58.787047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:08:11.402180 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:08:11.402094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:08:20.705099 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:08:20.705067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:08:30.299461 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:08:30.299422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:08:42.299986 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:08:42.299955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:09:01.556750 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:09:01.556716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:09:14.683784 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:09:14.683745    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:09:26.799153 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:09:26.799122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:09:37.586478 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:09:37.586403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:09:52.090794 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:09:52.090755    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:10:00.695468 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:10:00.695435    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:10:09.923517 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:10:09.923476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:10:29.284587 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:10:29.284549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:10:38.574363 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:10:38.574317    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:10:49.767762 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:10:49.767725    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:10:57.589722 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:10:57.589682    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:12:21.478509 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:12:21.478468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:12:30.273928 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:12:30.273888    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:12:44.082179 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:12:44.082098    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:12:54.883630 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:12:54.883596    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:13:28.177064 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.177033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:13:28.821089 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.821056    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"]
Jul 07 19:13:28.824454 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.824431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:28.826923 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.826895    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8f195932\"/\"kube-root-ca.crt\""
Jul 07 19:13:28.828002 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.827982    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8f195932\"/\"default-dockercfg-pxqdv\""
Jul 07 19:13:28.828122 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.828022    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8f195932\"/\"e2e-lifecycle-model-8f195932-kserve-self-signed-certs\""
Jul 07 19:13:28.828122 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.828045    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8f195932\"/\"openshift-service-ca.crt\""
Jul 07 19:13:28.837874 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.837850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"]
Jul 07 19:13:28.926793 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.926761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-dshm\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:28.926960 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.926796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-tmp-dir\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:28.926960 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.926832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-home\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:28.926960 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.926921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d8837b-e715-40ca-8f35-134d345b9b5f-tls-certs\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:28.926960 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.926954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-model-cache\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:28.927115 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:28.926997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpc22\" (UniqueName: \"kubernetes.io/projected/05d8837b-e715-40ca-8f35-134d345b9b5f-kube-api-access-cpc22\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.028412 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.028377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d8837b-e715-40ca-8f35-134d345b9b5f-tls-certs\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.028412 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.028420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-model-cache\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.028647 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.028452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpc22\" (UniqueName: \"kubernetes.io/projected/05d8837b-e715-40ca-8f35-134d345b9b5f-kube-api-access-cpc22\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.028647 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.028509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-dshm\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.028647 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.028534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-tmp-dir\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.028647 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.028571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-home\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.028998 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.028968    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-home\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.029350 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.029327    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-model-cache\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.029458 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.029437    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-tmp-dir\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.031015 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.030997    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-dshm\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.031294 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.031246    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d8837b-e715-40ca-8f35-134d345b9b5f-tls-certs\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.039707 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.039680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpc22\" (UniqueName: \"kubernetes.io/projected/05d8837b-e715-40ca-8f35-134d345b9b5f-kube-api-access-cpc22\") pod \"e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") " pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.134033 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.133935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:29.267936 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:29.267898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"]
Jul 07 19:13:29.272014 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:13:29.271989    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05d8837b_e715_40ca_8f35_134d345b9b5f.slice/crio-882f7bf09a025a38e48d1cdc04112767ca04d1c934af7f7d0e23e68286364a6e WatchSource:0}: Error finding container 882f7bf09a025a38e48d1cdc04112767ca04d1c934af7f7d0e23e68286364a6e: Status 404 returned error can't find the container with id 882f7bf09a025a38e48d1cdc04112767ca04d1c934af7f7d0e23e68286364a6e
Jul 07 19:13:30.055766 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:30.055734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh" event={"ID":"05d8837b-e715-40ca-8f35-134d345b9b5f","Type":"ContainerStarted","Data":"8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88"}
Jul 07 19:13:30.055766 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:30.055771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh" event={"ID":"05d8837b-e715-40ca-8f35-134d345b9b5f","Type":"ContainerStarted","Data":"882f7bf09a025a38e48d1cdc04112767ca04d1c934af7f7d0e23e68286364a6e"}
Jul 07 19:13:30.084840 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:30.084783    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh" podStartSLOduration=2.084766498 podStartE2EDuration="2.084766498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:13:30.083533341 +0000 UTC m=+1760.637424827" watchObservedRunningTime="2026-07-07 19:13:30.084766498 +0000 UTC m=+1760.638657983"
Jul 07 19:13:36.881334 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:36.881299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:13:39.134548 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:39.134516    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:39.134980 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:39.134566    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:39.148107 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:39.148080    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:40.108703 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:40.108677    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:13:46.793913 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:46.793881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:13:59.192354 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:59.192317    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:13:59.701555 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:13:59.701523    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"]
Jul 07 19:14:14.720992 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:14.720937    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh" podUID="05d8837b-e715-40ca-8f35-134d345b9b5f" containerName="main" containerID="cri-o://8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88" gracePeriod=45
Jul 07 19:14:14.960112 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:14.960085    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:14:15.021298 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021243    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpc22\" (UniqueName: \"kubernetes.io/projected/05d8837b-e715-40ca-8f35-134d345b9b5f-kube-api-access-cpc22\") pod \"05d8837b-e715-40ca-8f35-134d345b9b5f\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") "
Jul 07 19:14:15.021462 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021316    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-tmp-dir\") pod \"05d8837b-e715-40ca-8f35-134d345b9b5f\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") "
Jul 07 19:14:15.021462 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021348    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-dshm\") pod \"05d8837b-e715-40ca-8f35-134d345b9b5f\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") "
Jul 07 19:14:15.021462 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-home\") pod \"05d8837b-e715-40ca-8f35-134d345b9b5f\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") "
Jul 07 19:14:15.021462 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-model-cache\") pod \"05d8837b-e715-40ca-8f35-134d345b9b5f\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") "
Jul 07 19:14:15.021462 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d8837b-e715-40ca-8f35-134d345b9b5f-tls-certs\") pod \"05d8837b-e715-40ca-8f35-134d345b9b5f\" (UID: \"05d8837b-e715-40ca-8f35-134d345b9b5f\") "
Jul 07 19:14:15.021725 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021608    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "05d8837b-e715-40ca-8f35-134d345b9b5f" (UID: "05d8837b-e715-40ca-8f35-134d345b9b5f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:15.021725 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021712    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:14:15.021834 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021761    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-model-cache" (OuterVolumeSpecName: "model-cache") pod "05d8837b-e715-40ca-8f35-134d345b9b5f" (UID: "05d8837b-e715-40ca-8f35-134d345b9b5f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:15.021965 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.021921    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-home" (OuterVolumeSpecName: "home") pod "05d8837b-e715-40ca-8f35-134d345b9b5f" (UID: "05d8837b-e715-40ca-8f35-134d345b9b5f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:15.023638 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.023614    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-dshm" (OuterVolumeSpecName: "dshm") pod "05d8837b-e715-40ca-8f35-134d345b9b5f" (UID: "05d8837b-e715-40ca-8f35-134d345b9b5f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:15.023892 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.023870    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05d8837b-e715-40ca-8f35-134d345b9b5f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "05d8837b-e715-40ca-8f35-134d345b9b5f" (UID: "05d8837b-e715-40ca-8f35-134d345b9b5f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:14:15.023892 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.023874    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d8837b-e715-40ca-8f35-134d345b9b5f-kube-api-access-cpc22" (OuterVolumeSpecName: "kube-api-access-cpc22") pod "05d8837b-e715-40ca-8f35-134d345b9b5f" (UID: "05d8837b-e715-40ca-8f35-134d345b9b5f"). InnerVolumeSpecName "kube-api-access-cpc22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:14:15.122191 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.122157    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpc22\" (UniqueName: \"kubernetes.io/projected/05d8837b-e715-40ca-8f35-134d345b9b5f-kube-api-access-cpc22\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:14:15.122191 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.122186    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:14:15.122191 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.122196    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:14:15.122429 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.122204    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05d8837b-e715-40ca-8f35-134d345b9b5f-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:14:15.122429 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.122214    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d8837b-e715-40ca-8f35-134d345b9b5f-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:14:15.239318 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.239281    2581 generic.go:356] "Generic (PLEG): container finished" podID="05d8837b-e715-40ca-8f35-134d345b9b5f" containerID="8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88" exitCode=0
Jul 07 19:14:15.239318 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.239321    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"
Jul 07 19:14:15.239525 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.239369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh" event={"ID":"05d8837b-e715-40ca-8f35-134d345b9b5f","Type":"ContainerDied","Data":"8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88"}
Jul 07 19:14:15.239525 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.239412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh" event={"ID":"05d8837b-e715-40ca-8f35-134d345b9b5f","Type":"ContainerDied","Data":"882f7bf09a025a38e48d1cdc04112767ca04d1c934af7f7d0e23e68286364a6e"}
Jul 07 19:14:15.239525 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.239431    2581 scope.go:117] "RemoveContainer" containerID="8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88"
Jul 07 19:14:15.247742 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.247725    2581 scope.go:117] "RemoveContainer" containerID="8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88"
Jul 07 19:14:15.247991 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:14:15.247969    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88\": container with ID starting with 8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88 not found: ID does not exist" containerID="8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88"
Jul 07 19:14:15.248060 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.248005    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88"} err="failed to get container status \"8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88\": rpc error: code = NotFound desc = could not find container \"8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88\": container with ID starting with 8753d9bc794168dca3d1a2f13c545839b14320aef4739fccc4120010c9eebc88 not found: ID does not exist"
Jul 07 19:14:15.262149 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.262127    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"]
Jul 07 19:14:15.268382 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.268362    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8f195932/e2e-lifecycle-model-8f195932-kserve-7d97ff87cf-s9qmh"]
Jul 07 19:14:15.947154 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:15.947124    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05d8837b-e715-40ca-8f35-134d345b9b5f" path="/var/lib/kubelet/pods/05d8837b-e715-40ca-8f35-134d345b9b5f/volumes"
Jul 07 19:14:39.987270 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:39.987220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:14:54.303514 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:14:54.303479    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:15:00.151968 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.151935    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724195-m7q7l"]
Jul 07 19:15:00.152355 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.152219    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d8837b-e715-40ca-8f35-134d345b9b5f" containerName="main"
Jul 07 19:15:00.152355 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.152230    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d8837b-e715-40ca-8f35-134d345b9b5f" containerName="main"
Jul 07 19:15:00.152355 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.152306    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d8837b-e715-40ca-8f35-134d345b9b5f" containerName="main"
Jul 07 19:15:00.155111 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.155096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l"
Jul 07 19:15:00.157555 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.157534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:15:00.164797 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.164774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724195-m7q7l"]
Jul 07 19:15:00.182992 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.182970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88rml\" (UniqueName: \"kubernetes.io/projected/24e256e8-ba62-4072-a220-98a5552351bd-kube-api-access-88rml\") pod \"maas-api-key-cleanup-29724195-m7q7l\" (UID: \"24e256e8-ba62-4072-a220-98a5552351bd\") " pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l"
Jul 07 19:15:00.284164 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.284131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88rml\" (UniqueName: \"kubernetes.io/projected/24e256e8-ba62-4072-a220-98a5552351bd-kube-api-access-88rml\") pod \"maas-api-key-cleanup-29724195-m7q7l\" (UID: \"24e256e8-ba62-4072-a220-98a5552351bd\") " pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l"
Jul 07 19:15:00.294457 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.294432    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88rml\" (UniqueName: \"kubernetes.io/projected/24e256e8-ba62-4072-a220-98a5552351bd-kube-api-access-88rml\") pod \"maas-api-key-cleanup-29724195-m7q7l\" (UID: \"24e256e8-ba62-4072-a220-98a5552351bd\") " pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l"
Jul 07 19:15:00.466437 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.466359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l"
Jul 07 19:15:00.595301 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:00.595279    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724195-m7q7l"]
Jul 07 19:15:00.597704 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:15:00.597678    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e256e8_ba62_4072_a220_98a5552351bd.slice/crio-e6d20ab53538ee7759a250e6adc184d776c6fda4618a8ff1687598ebe1455d6d WatchSource:0}: Error finding container e6d20ab53538ee7759a250e6adc184d776c6fda4618a8ff1687598ebe1455d6d: Status 404 returned error can't find the container with id e6d20ab53538ee7759a250e6adc184d776c6fda4618a8ff1687598ebe1455d6d
Jul 07 19:15:01.429669 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:01.429631    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l" event={"ID":"24e256e8-ba62-4072-a220-98a5552351bd","Type":"ContainerStarted","Data":"55e199f4ac3c84afd8ab2a43176e0a66db82491284ee2f6cd789d897df2991ce"}
Jul 07 19:15:01.430085 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:01.429687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l" event={"ID":"24e256e8-ba62-4072-a220-98a5552351bd","Type":"ContainerStarted","Data":"e6d20ab53538ee7759a250e6adc184d776c6fda4618a8ff1687598ebe1455d6d"}
Jul 07 19:15:01.447748 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:01.447705    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l" podStartSLOduration=1.447691236 podStartE2EDuration="1.447691236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:01.446464711 +0000 UTC m=+1852.000356199" watchObservedRunningTime="2026-07-07 19:15:01.447691236 +0000 UTC m=+1852.001582721"
Jul 07 19:15:02.435607 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:02.435572    2581 generic.go:356] "Generic (PLEG): container finished" podID="24e256e8-ba62-4072-a220-98a5552351bd" containerID="55e199f4ac3c84afd8ab2a43176e0a66db82491284ee2f6cd789d897df2991ce" exitCode=0
Jul 07 19:15:02.436000 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:02.435664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l" event={"ID":"24e256e8-ba62-4072-a220-98a5552351bd","Type":"ContainerDied","Data":"55e199f4ac3c84afd8ab2a43176e0a66db82491284ee2f6cd789d897df2991ce"}
Jul 07 19:15:03.563450 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:03.563427    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l"
Jul 07 19:15:03.609630 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:03.609605    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88rml\" (UniqueName: \"kubernetes.io/projected/24e256e8-ba62-4072-a220-98a5552351bd-kube-api-access-88rml\") pod \"24e256e8-ba62-4072-a220-98a5552351bd\" (UID: \"24e256e8-ba62-4072-a220-98a5552351bd\") "
Jul 07 19:15:03.611649 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:03.611622    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e256e8-ba62-4072-a220-98a5552351bd-kube-api-access-88rml" (OuterVolumeSpecName: "kube-api-access-88rml") pod "24e256e8-ba62-4072-a220-98a5552351bd" (UID: "24e256e8-ba62-4072-a220-98a5552351bd"). InnerVolumeSpecName "kube-api-access-88rml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:03.710916 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:03.710838    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88rml\" (UniqueName: \"kubernetes.io/projected/24e256e8-ba62-4072-a220-98a5552351bd-kube-api-access-88rml\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:15:04.445161 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:04.445128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l" event={"ID":"24e256e8-ba62-4072-a220-98a5552351bd","Type":"ContainerDied","Data":"e6d20ab53538ee7759a250e6adc184d776c6fda4618a8ff1687598ebe1455d6d"}
Jul 07 19:15:04.445161 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:04.445152    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724195-m7q7l"
Jul 07 19:15:04.445387 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:04.445173    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6d20ab53538ee7759a250e6adc184d776c6fda4618a8ff1687598ebe1455d6d"
Jul 07 19:15:05.477619 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:05.477584    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:15:57.487809 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:15:57.487767    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:16:07.577996 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:07.577958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:16:25.803585 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.803555    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"]
Jul 07 19:16:25.804135 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.803866    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e256e8-ba62-4072-a220-98a5552351bd" containerName="cleanup"
Jul 07 19:16:25.804135 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.803877    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e256e8-ba62-4072-a220-98a5552351bd" containerName="cleanup"
Jul 07 19:16:25.804135 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.803949    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e256e8-ba62-4072-a220-98a5552351bd" containerName="cleanup"
Jul 07 19:16:25.807017 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.806998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.809389 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.809370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0d53f1\"/\"kube-root-ca.crt\""
Jul 07 19:16:25.810404 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.810385    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0d53f1\"/\"openshift-service-ca.crt\""
Jul 07 19:16:25.810468 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.810391    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0d53f1\"/\"test-model-0d53f1-kserve-self-signed-certs\""
Jul 07 19:16:25.810518 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.810481    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0d53f1\"/\"default-dockercfg-cmhl6\""
Jul 07 19:16:25.819847 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.819828    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"]
Jul 07 19:16:25.861160 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.861130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-dshm\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.861160 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.861160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dqld\" (UniqueName: \"kubernetes.io/projected/d2edd9ac-49cc-4fcb-9054-793268ddae50-kube-api-access-8dqld\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.861338 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.861183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-tmp-dir\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.861338 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.861201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-home\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.861338 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.861324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-model-cache\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.861441 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.861353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2edd9ac-49cc-4fcb-9054-793268ddae50-tls-certs\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.961772 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.961738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-dshm\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.961772 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.961774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dqld\" (UniqueName: \"kubernetes.io/projected/d2edd9ac-49cc-4fcb-9054-793268ddae50-kube-api-access-8dqld\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.962015 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.961811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-tmp-dir\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.962015 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.961835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-home\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.962015 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.961895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-model-cache\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.962015 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.961923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2edd9ac-49cc-4fcb-9054-793268ddae50-tls-certs\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.962243 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.962222    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-tmp-dir\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.962337 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.962244    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-model-cache\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.962337 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.962310    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-home\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.964115 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.964091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-dshm\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.964357 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.964340    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2edd9ac-49cc-4fcb-9054-793268ddae50-tls-certs\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:25.970883 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:25.970861    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dqld\" (UniqueName: \"kubernetes.io/projected/d2edd9ac-49cc-4fcb-9054-793268ddae50-kube-api-access-8dqld\") pod \"test-model-0d53f1-kserve-d4744b8cf-hpksc\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") " pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:26.116594 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:26.116495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:26.248442 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:26.248283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"]
Jul 07 19:16:26.250595 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:16:26.250563    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2edd9ac_49cc_4fcb_9054_793268ddae50.slice/crio-920badb706e71a2a9a096aceb8d6f48996dcab42eb426889cbb26aae33a5877a WatchSource:0}: Error finding container 920badb706e71a2a9a096aceb8d6f48996dcab42eb426889cbb26aae33a5877a: Status 404 returned error can't find the container with id 920badb706e71a2a9a096aceb8d6f48996dcab42eb426889cbb26aae33a5877a
Jul 07 19:16:26.778990 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:26.778955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc" event={"ID":"d2edd9ac-49cc-4fcb-9054-793268ddae50","Type":"ContainerStarted","Data":"a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3"}
Jul 07 19:16:26.779163 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:26.778999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc" event={"ID":"d2edd9ac-49cc-4fcb-9054-793268ddae50","Type":"ContainerStarted","Data":"920badb706e71a2a9a096aceb8d6f48996dcab42eb426889cbb26aae33a5877a"}
Jul 07 19:16:26.805846 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:26.805789    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc" podStartSLOduration=1.805774304 podStartE2EDuration="1.805774304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:16:26.803819615 +0000 UTC m=+1937.357711101" watchObservedRunningTime="2026-07-07 19:16:26.805774304 +0000 UTC m=+1937.359665790"
Jul 07 19:16:29.126972 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:29.126933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:16:36.117443 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:36.117408    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:36.117954 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:36.117464    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:36.129879 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:36.129853    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:36.835754 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:36.835727    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:16:42.604069 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:42.604037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:16:56.233628 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.233594    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"]
Jul 07 19:16:56.236813 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.236798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.240544 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.240519    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-02a18f\"/\"kube-root-ca.crt\""
Jul 07 19:16:56.240685 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.240572    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-02a18f\"/\"default-dockercfg-cckl4\""
Jul 07 19:16:56.240685 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.240520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-02a18f\"/\"test-model-02a18f-kserve-self-signed-certs\""
Jul 07 19:16:56.240685 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.240619    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-02a18f\"/\"openshift-service-ca.crt\""
Jul 07 19:16:56.254904 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.254877    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"]
Jul 07 19:16:56.310905 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.310880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8948672c-7879-441b-b049-becfc7f82269-tls-certs\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.311062 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.310923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-model-cache\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.311062 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.310946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-home\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.311159 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.311087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-dshm\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.311159 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.311136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-tmp-dir\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.311236 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.311160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrpzq\" (UniqueName: \"kubernetes.io/projected/8948672c-7879-441b-b049-becfc7f82269-kube-api-access-hrpzq\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.411956 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.411927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-dshm\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412122 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.411961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-tmp-dir\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412122 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.411980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrpzq\" (UniqueName: \"kubernetes.io/projected/8948672c-7879-441b-b049-becfc7f82269-kube-api-access-hrpzq\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412122 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.412002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8948672c-7879-441b-b049-becfc7f82269-tls-certs\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412289 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.412154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-model-cache\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412289 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.412198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-home\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412465 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.412434    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-tmp-dir\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412570 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.412520    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-model-cache\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.412570 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.412555    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-home\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.414347 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.414328    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-dshm\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.414720 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.414704    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8948672c-7879-441b-b049-becfc7f82269-tls-certs\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.422359 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.422338    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrpzq\" (UniqueName: \"kubernetes.io/projected/8948672c-7879-441b-b049-becfc7f82269-kube-api-access-hrpzq\") pod \"test-model-02a18f-kserve-5d577f56d5-rghmw\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") " pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.547511 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.547429    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:16:56.687995 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.687967    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"]
Jul 07 19:16:56.689866 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:16:56.689837    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8948672c_7879_441b_b049_becfc7f82269.slice/crio-11e54bc273500b429a487ad4ed88b36693f31536edf5778a9de9ff8196a7be8a WatchSource:0}: Error finding container 11e54bc273500b429a487ad4ed88b36693f31536edf5778a9de9ff8196a7be8a: Status 404 returned error can't find the container with id 11e54bc273500b429a487ad4ed88b36693f31536edf5778a9de9ff8196a7be8a
Jul 07 19:16:56.909694 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.909559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw" event={"ID":"8948672c-7879-441b-b049-becfc7f82269","Type":"ContainerStarted","Data":"c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868"}
Jul 07 19:16:56.909694 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.909603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw" event={"ID":"8948672c-7879-441b-b049-becfc7f82269","Type":"ContainerStarted","Data":"11e54bc273500b429a487ad4ed88b36693f31536edf5778a9de9ff8196a7be8a"}
Jul 07 19:16:56.931068 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:16:56.931025    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw" podStartSLOduration=0.93101136 podStartE2EDuration="931.01136ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:16:56.929379288 +0000 UTC m=+1967.483270777" watchObservedRunningTime="2026-07-07 19:16:56.93101136 +0000 UTC m=+1967.484902845"
Jul 07 19:17:00.480494 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:00.480452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:17:06.548012 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:06.547907    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:17:06.548012 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:06.547975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:17:06.560625 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:06.560594    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:17:06.963519 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:06.963443    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:17:15.870741 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:15.870706    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:17:16.763393 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:16.763356    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"]
Jul 07 19:17:17.697549 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:17.697518    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"]
Jul 07 19:17:28.384962 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:28.384925    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:17:31.782741 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:31.782692    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc" podUID="d2edd9ac-49cc-4fcb-9054-793268ddae50" containerName="main" containerID="cri-o://a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3" gracePeriod=45
Jul 07 19:17:32.024087 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.024065    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:17:32.063314 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.063223    2581 generic.go:356] "Generic (PLEG): container finished" podID="d2edd9ac-49cc-4fcb-9054-793268ddae50" containerID="a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3" exitCode=0
Jul 07 19:17:32.063314 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.063289    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"
Jul 07 19:17:32.063484 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.063287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc" event={"ID":"d2edd9ac-49cc-4fcb-9054-793268ddae50","Type":"ContainerDied","Data":"a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3"}
Jul 07 19:17:32.063484 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.063400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc" event={"ID":"d2edd9ac-49cc-4fcb-9054-793268ddae50","Type":"ContainerDied","Data":"920badb706e71a2a9a096aceb8d6f48996dcab42eb426889cbb26aae33a5877a"}
Jul 07 19:17:32.063484 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.063427    2581 scope.go:117] "RemoveContainer" containerID="a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3"
Jul 07 19:17:32.071518 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.071504    2581 scope.go:117] "RemoveContainer" containerID="a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3"
Jul 07 19:17:32.071760 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:17:32.071742    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3\": container with ID starting with a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3 not found: ID does not exist" containerID="a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3"
Jul 07 19:17:32.071829 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.071773    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3"} err="failed to get container status \"a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3\": rpc error: code = NotFound desc = could not find container \"a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3\": container with ID starting with a355039369665330d4afed4e255541bc372f4433b0afc5a1597a7326e6ce29c3 not found: ID does not exist"
Jul 07 19:17:32.113373 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113345    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-tmp-dir\") pod \"d2edd9ac-49cc-4fcb-9054-793268ddae50\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") "
Jul 07 19:17:32.113513 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113381    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-home\") pod \"d2edd9ac-49cc-4fcb-9054-793268ddae50\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") "
Jul 07 19:17:32.113513 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113420    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-model-cache\") pod \"d2edd9ac-49cc-4fcb-9054-793268ddae50\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") "
Jul 07 19:17:32.113513 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113451    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2edd9ac-49cc-4fcb-9054-793268ddae50-tls-certs\") pod \"d2edd9ac-49cc-4fcb-9054-793268ddae50\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") "
Jul 07 19:17:32.113513 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113490    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-dshm\") pod \"d2edd9ac-49cc-4fcb-9054-793268ddae50\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") "
Jul 07 19:17:32.113723 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113561    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dqld\" (UniqueName: \"kubernetes.io/projected/d2edd9ac-49cc-4fcb-9054-793268ddae50-kube-api-access-8dqld\") pod \"d2edd9ac-49cc-4fcb-9054-793268ddae50\" (UID: \"d2edd9ac-49cc-4fcb-9054-793268ddae50\") "
Jul 07 19:17:32.113723 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113608    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-home" (OuterVolumeSpecName: "home") pod "d2edd9ac-49cc-4fcb-9054-793268ddae50" (UID: "d2edd9ac-49cc-4fcb-9054-793268ddae50"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:32.113723 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113633    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2edd9ac-49cc-4fcb-9054-793268ddae50" (UID: "d2edd9ac-49cc-4fcb-9054-793268ddae50"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:32.113723 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113705    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2edd9ac-49cc-4fcb-9054-793268ddae50" (UID: "d2edd9ac-49cc-4fcb-9054-793268ddae50"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:32.113936 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113819    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:32.113936 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113851    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:32.113936 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.113864    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:32.117781 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.116639    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2edd9ac-49cc-4fcb-9054-793268ddae50-kube-api-access-8dqld" (OuterVolumeSpecName: "kube-api-access-8dqld") pod "d2edd9ac-49cc-4fcb-9054-793268ddae50" (UID: "d2edd9ac-49cc-4fcb-9054-793268ddae50"). InnerVolumeSpecName "kube-api-access-8dqld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:17:32.117901 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.117828    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2edd9ac-49cc-4fcb-9054-793268ddae50-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2edd9ac-49cc-4fcb-9054-793268ddae50" (UID: "d2edd9ac-49cc-4fcb-9054-793268ddae50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:17:32.118023 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.118004    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-dshm" (OuterVolumeSpecName: "dshm") pod "d2edd9ac-49cc-4fcb-9054-793268ddae50" (UID: "d2edd9ac-49cc-4fcb-9054-793268ddae50"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:32.215209 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.215177    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2edd9ac-49cc-4fcb-9054-793268ddae50-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:32.215209 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.215208    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2edd9ac-49cc-4fcb-9054-793268ddae50-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:32.215404 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.215221    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dqld\" (UniqueName: \"kubernetes.io/projected/d2edd9ac-49cc-4fcb-9054-793268ddae50-kube-api-access-8dqld\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:32.387627 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.387600    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"]
Jul 07 19:17:32.392382 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.392357    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0d53f1/test-model-0d53f1-kserve-d4744b8cf-hpksc"]
Jul 07 19:17:32.717370 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.717239    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw" podUID="8948672c-7879-441b-b049-becfc7f82269" containerName="main" containerID="cri-o://c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868" gracePeriod=45
Jul 07 19:17:32.964311 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:32.964289    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:17:33.021695 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.021662    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8948672c-7879-441b-b049-becfc7f82269-tls-certs\") pod \"8948672c-7879-441b-b049-becfc7f82269\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") "
Jul 07 19:17:33.021869 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.021710    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrpzq\" (UniqueName: \"kubernetes.io/projected/8948672c-7879-441b-b049-becfc7f82269-kube-api-access-hrpzq\") pod \"8948672c-7879-441b-b049-becfc7f82269\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") "
Jul 07 19:17:33.021869 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.021733    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-home\") pod \"8948672c-7879-441b-b049-becfc7f82269\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") "
Jul 07 19:17:33.021869 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.021753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-tmp-dir\") pod \"8948672c-7879-441b-b049-becfc7f82269\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") "
Jul 07 19:17:33.021869 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.021786    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-dshm\") pod \"8948672c-7879-441b-b049-becfc7f82269\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") "
Jul 07 19:17:33.021869 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.021817    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-model-cache\") pod \"8948672c-7879-441b-b049-becfc7f82269\" (UID: \"8948672c-7879-441b-b049-becfc7f82269\") "
Jul 07 19:17:33.022123 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.022106    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-home" (OuterVolumeSpecName: "home") pod "8948672c-7879-441b-b049-becfc7f82269" (UID: "8948672c-7879-441b-b049-becfc7f82269"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:33.022193 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.022100    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8948672c-7879-441b-b049-becfc7f82269" (UID: "8948672c-7879-441b-b049-becfc7f82269"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:33.022193 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.022130    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-model-cache" (OuterVolumeSpecName: "model-cache") pod "8948672c-7879-441b-b049-becfc7f82269" (UID: "8948672c-7879-441b-b049-becfc7f82269"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:33.024066 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.024042    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-dshm" (OuterVolumeSpecName: "dshm") pod "8948672c-7879-441b-b049-becfc7f82269" (UID: "8948672c-7879-441b-b049-becfc7f82269"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:33.024202 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.024174    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8948672c-7879-441b-b049-becfc7f82269-kube-api-access-hrpzq" (OuterVolumeSpecName: "kube-api-access-hrpzq") pod "8948672c-7879-441b-b049-becfc7f82269" (UID: "8948672c-7879-441b-b049-becfc7f82269"). InnerVolumeSpecName "kube-api-access-hrpzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:17:33.024202 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.024190    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8948672c-7879-441b-b049-becfc7f82269-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8948672c-7879-441b-b049-becfc7f82269" (UID: "8948672c-7879-441b-b049-becfc7f82269"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:17:33.071003 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.070971    2581 generic.go:356] "Generic (PLEG): container finished" podID="8948672c-7879-441b-b049-becfc7f82269" containerID="c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868" exitCode=0
Jul 07 19:17:33.071138 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.071028    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"
Jul 07 19:17:33.071138 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.071049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw" event={"ID":"8948672c-7879-441b-b049-becfc7f82269","Type":"ContainerDied","Data":"c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868"}
Jul 07 19:17:33.071138 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.071097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw" event={"ID":"8948672c-7879-441b-b049-becfc7f82269","Type":"ContainerDied","Data":"11e54bc273500b429a487ad4ed88b36693f31536edf5778a9de9ff8196a7be8a"}
Jul 07 19:17:33.071138 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.071118    2581 scope.go:117] "RemoveContainer" containerID="c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868"
Jul 07 19:17:33.079113 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.079089    2581 scope.go:117] "RemoveContainer" containerID="c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868"
Jul 07 19:17:33.079489 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:17:33.079466    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868\": container with ID starting with c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868 not found: ID does not exist" containerID="c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868"
Jul 07 19:17:33.079569 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.079501    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868"} err="failed to get container status \"c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868\": rpc error: code = NotFound desc = could not find container \"c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868\": container with ID starting with c7391f243cdb69c3f1048e06cf655f88b24c2d378d7838bafb63e4b969bb6868 not found: ID does not exist"
Jul 07 19:17:33.093370 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.093346    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"]
Jul 07 19:17:33.099346 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.099329    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-02a18f/test-model-02a18f-kserve-5d577f56d5-rghmw"]
Jul 07 19:17:33.122682 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.122659    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8948672c-7879-441b-b049-becfc7f82269-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:33.122682 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.122679    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrpzq\" (UniqueName: \"kubernetes.io/projected/8948672c-7879-441b-b049-becfc7f82269-kube-api-access-hrpzq\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:33.122800 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.122689    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:33.122800 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.122699    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:33.122800 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.122707    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:33.122800 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.122715    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8948672c-7879-441b-b049-becfc7f82269-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:17:33.948165 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.948122    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8948672c-7879-441b-b049-becfc7f82269" path="/var/lib/kubelet/pods/8948672c-7879-441b-b049-becfc7f82269/volumes"
Jul 07 19:17:33.948629 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:17:33.948607    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2edd9ac-49cc-4fcb-9054-793268ddae50" path="/var/lib/kubelet/pods/d2edd9ac-49cc-4fcb-9054-793268ddae50/volumes"
Jul 07 19:18:05.097276 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:05.097228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:18:17.817283 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:17.816133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:18:21.064710 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.064679    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"]
Jul 07 19:18:21.065168 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.064967    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8948672c-7879-441b-b049-becfc7f82269" containerName="main"
Jul 07 19:18:21.065168 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.064981    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8948672c-7879-441b-b049-becfc7f82269" containerName="main"
Jul 07 19:18:21.065168 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.065003    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2edd9ac-49cc-4fcb-9054-793268ddae50" containerName="main"
Jul 07 19:18:21.065168 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.065010    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2edd9ac-49cc-4fcb-9054-793268ddae50" containerName="main"
Jul 07 19:18:21.065168 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.065062    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8948672c-7879-441b-b049-becfc7f82269" containerName="main"
Jul 07 19:18:21.065168 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.065069    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2edd9ac-49cc-4fcb-9054-793268ddae50" containerName="main"
Jul 07 19:18:21.068073 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.068053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.070528 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.070503    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-283790-serving-cert\""
Jul 07 19:18:21.070650 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.070528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:18:21.080052 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.080026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"]
Jul 07 19:18:21.115187 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.115154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khg85\" (UniqueName: \"kubernetes.io/projected/52b41508-5a85-4909-9801-5019fc2797fa-kube-api-access-khg85\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.115336 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.115202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b41508-5a85-4909-9801-5019fc2797fa-maas-api-tls\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.115336 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.115325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b41508-5a85-4909-9801-5019fc2797fa-openshift-service-ca\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.215726 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.215678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b41508-5a85-4909-9801-5019fc2797fa-openshift-service-ca\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.215920 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.215774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khg85\" (UniqueName: \"kubernetes.io/projected/52b41508-5a85-4909-9801-5019fc2797fa-kube-api-access-khg85\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.215920 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.215798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b41508-5a85-4909-9801-5019fc2797fa-maas-api-tls\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.216416 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.216395    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b41508-5a85-4909-9801-5019fc2797fa-openshift-service-ca\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.218153 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.218135    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b41508-5a85-4909-9801-5019fc2797fa-maas-api-tls\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.227791 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.227766    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khg85\" (UniqueName: \"kubernetes.io/projected/52b41508-5a85-4909-9801-5019fc2797fa-kube-api-access-khg85\") pod \"maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") " pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.378808 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.378700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:21.510397 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.510325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"]
Jul 07 19:18:21.513098 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:18:21.513072    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b41508_5a85_4909_9801_5019fc2797fa.slice/crio-fc1b8a914ea5289a933a2608f31a81fe14f15bd2e1487bb741c1f66f646407a2 WatchSource:0}: Error finding container fc1b8a914ea5289a933a2608f31a81fe14f15bd2e1487bb741c1f66f646407a2: Status 404 returned error can't find the container with id fc1b8a914ea5289a933a2608f31a81fe14f15bd2e1487bb741c1f66f646407a2
Jul 07 19:18:21.514521 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:21.514503    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:18:22.276049 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:22.275974    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls" event={"ID":"52b41508-5a85-4909-9801-5019fc2797fa","Type":"ContainerStarted","Data":"fc1b8a914ea5289a933a2608f31a81fe14f15bd2e1487bb741c1f66f646407a2"}
Jul 07 19:18:23.281246 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:23.281216    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls" event={"ID":"52b41508-5a85-4909-9801-5019fc2797fa","Type":"ContainerStarted","Data":"c48f4e8d0d53efb780c1500cac70aebf47cb8840033b88174091155960a690e7"}
Jul 07 19:18:23.281653 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:23.281289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:23.299295 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:23.299229    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls" podStartSLOduration=0.647636377 podStartE2EDuration="2.29921393s" totalImagesPullingTime="1.651577553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:23.298545103 +0000 UTC m=+2053.852436592" watchObservedRunningTime="2026-07-07 19:18:23.29921393 +0000 UTC m=+2053.853105424"
Jul 07 19:18:29.095209 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:29.095168    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:18:29.290075 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:29.290043    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:40.384694 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:40.384619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:18:42.230773 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.230740    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"]
Jul 07 19:18:42.231151 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.230949    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls" podUID="52b41508-5a85-4909-9801-5019fc2797fa" containerName="maas-api" containerID="cri-o://c48f4e8d0d53efb780c1500cac70aebf47cb8840033b88174091155960a690e7" gracePeriod=30
Jul 07 19:18:42.363444 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.363406    2581 generic.go:356] "Generic (PLEG): container finished" podID="52b41508-5a85-4909-9801-5019fc2797fa" containerID="c48f4e8d0d53efb780c1500cac70aebf47cb8840033b88174091155960a690e7" exitCode=0
Jul 07 19:18:42.363579 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.363476    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls" event={"ID":"52b41508-5a85-4909-9801-5019fc2797fa","Type":"ContainerDied","Data":"c48f4e8d0d53efb780c1500cac70aebf47cb8840033b88174091155960a690e7"}
Jul 07 19:18:42.478805 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.478781    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:42.589237 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.589197    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khg85\" (UniqueName: \"kubernetes.io/projected/52b41508-5a85-4909-9801-5019fc2797fa-kube-api-access-khg85\") pod \"52b41508-5a85-4909-9801-5019fc2797fa\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") "
Jul 07 19:18:42.589455 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.589314    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b41508-5a85-4909-9801-5019fc2797fa-maas-api-tls\") pod \"52b41508-5a85-4909-9801-5019fc2797fa\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") "
Jul 07 19:18:42.589455 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.589339    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b41508-5a85-4909-9801-5019fc2797fa-openshift-service-ca\") pod \"52b41508-5a85-4909-9801-5019fc2797fa\" (UID: \"52b41508-5a85-4909-9801-5019fc2797fa\") "
Jul 07 19:18:42.589758 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.589729    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b41508-5a85-4909-9801-5019fc2797fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52b41508-5a85-4909-9801-5019fc2797fa" (UID: "52b41508-5a85-4909-9801-5019fc2797fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:42.591368 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.591340    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b41508-5a85-4909-9801-5019fc2797fa-kube-api-access-khg85" (OuterVolumeSpecName: "kube-api-access-khg85") pod "52b41508-5a85-4909-9801-5019fc2797fa" (UID: "52b41508-5a85-4909-9801-5019fc2797fa"). InnerVolumeSpecName "kube-api-access-khg85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:42.591461 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.591402    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b41508-5a85-4909-9801-5019fc2797fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52b41508-5a85-4909-9801-5019fc2797fa" (UID: "52b41508-5a85-4909-9801-5019fc2797fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:18:42.690787 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.690747    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52b41508-5a85-4909-9801-5019fc2797fa-maas-api-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:18:42.690787 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.690780    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b41508-5a85-4909-9801-5019fc2797fa-openshift-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:18:42.690787 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:42.690794    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khg85\" (UniqueName: \"kubernetes.io/projected/52b41508-5a85-4909-9801-5019fc2797fa-kube-api-access-khg85\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:18:43.368602 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:43.368574    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"
Jul 07 19:18:43.369030 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:43.368604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls" event={"ID":"52b41508-5a85-4909-9801-5019fc2797fa","Type":"ContainerDied","Data":"fc1b8a914ea5289a933a2608f31a81fe14f15bd2e1487bb741c1f66f646407a2"}
Jul 07 19:18:43.369030 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:43.368661    2581 scope.go:117] "RemoveContainer" containerID="c48f4e8d0d53efb780c1500cac70aebf47cb8840033b88174091155960a690e7"
Jul 07 19:18:43.395719 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:43.395696    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"]
Jul 07 19:18:43.409804 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:43.409778    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-283790-6b8c8f95fd-9j4ls"]
Jul 07 19:18:43.946321 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:43.946286    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b41508-5a85-4909-9801-5019fc2797fa" path="/var/lib/kubelet/pods/52b41508-5a85-4909-9801-5019fc2797fa/volumes"
Jul 07 19:18:51.488893 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:51.488859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:18:52.131801 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.131769    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"]
Jul 07 19:18:52.132059 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.132047    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b41508-5a85-4909-9801-5019fc2797fa" containerName="maas-api"
Jul 07 19:18:52.132106 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.132060    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b41508-5a85-4909-9801-5019fc2797fa" containerName="maas-api"
Jul 07 19:18:52.132140 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.132120    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b41508-5a85-4909-9801-5019fc2797fa" containerName="maas-api"
Jul 07 19:18:52.135060 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.135043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.137363 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.137334    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-dedce5-serving-cert\""
Jul 07 19:18:52.137484 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.137426    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:18:52.155614 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.155592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"]
Jul 07 19:18:52.269279 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.269235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.269450 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.269371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhxmw\" (UniqueName: \"kubernetes.io/projected/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-kube-api-access-qhxmw\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.269450 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.269411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.370084 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.370047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhxmw\" (UniqueName: \"kubernetes.io/projected/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-kube-api-access-qhxmw\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.370084 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.370087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.370337 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.370115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.370337 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:18:52.370220    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-dedce5-serving-cert: secret "maas-api-e2e-shared-a-dedce5-serving-cert" not found
Jul 07 19:18:52.370337 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:18:52.370318    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls podName:1fff0ec4-ef58-4274-99e4-9c5fbaaa721d nodeName:}" failed. No retries permitted until 2026-07-07 19:18:52.870296492 +0000 UTC m=+2083.424187956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls") pod "maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls" (UID: "1fff0ec4-ef58-4274-99e4-9c5fbaaa721d") : secret "maas-api-e2e-shared-a-dedce5-serving-cert" not found
Jul 07 19:18:52.370738 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.370721    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.387173 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.387118    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhxmw\" (UniqueName: \"kubernetes.io/projected/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-kube-api-access-qhxmw\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.874003 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.873962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:52.876514 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:52.876490    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls\") pod \"maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") " pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:53.045188 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:53.045146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:53.176196 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:53.176167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"]
Jul 07 19:18:53.178558 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:18:53.178529    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fff0ec4_ef58_4274_99e4_9c5fbaaa721d.slice/crio-53cb251fcdf78977acde5b3ef0f7770536d34ac2d94d3fad8c2d05a322cf5bb5 WatchSource:0}: Error finding container 53cb251fcdf78977acde5b3ef0f7770536d34ac2d94d3fad8c2d05a322cf5bb5: Status 404 returned error can't find the container with id 53cb251fcdf78977acde5b3ef0f7770536d34ac2d94d3fad8c2d05a322cf5bb5
Jul 07 19:18:53.410308 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:53.410196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls" event={"ID":"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d","Type":"ContainerStarted","Data":"53cb251fcdf78977acde5b3ef0f7770536d34ac2d94d3fad8c2d05a322cf5bb5"}
Jul 07 19:18:54.416299 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:54.416245    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls" event={"ID":"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d","Type":"ContainerStarted","Data":"d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611"}
Jul 07 19:18:54.416779 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:54.416357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:18:54.437047 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:18:54.436995    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls" podStartSLOduration=2.077174668 podStartE2EDuration="2.436977017s" totalImagesPullingTime="359.802349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:54.435009089 +0000 UTC m=+2084.988900576" watchObservedRunningTime="2026-07-07 19:18:54.436977017 +0000 UTC m=+2084.990868504"
Jul 07 19:19:00.333493 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.333459    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"]
Jul 07 19:19:00.337026 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.337005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.339921 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.339895    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-d57d53-serving-cert\""
Jul 07 19:19:00.351583 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.351559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"]
Jul 07 19:19:00.425904 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.425874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:19:00.440305 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.440245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38474f3-5398-44d4-8770-7b52f5444e7e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.440459 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.440409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.440459 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.440442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbsrq\" (UniqueName: \"kubernetes.io/projected/d38474f3-5398-44d4-8770-7b52f5444e7e-kube-api-access-tbsrq\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.541340 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.541299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38474f3-5398-44d4-8770-7b52f5444e7e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.541489 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.541425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.541489 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.541457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbsrq\" (UniqueName: \"kubernetes.io/projected/d38474f3-5398-44d4-8770-7b52f5444e7e-kube-api-access-tbsrq\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.541603 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:19:00.541583    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-d57d53-serving-cert: secret "maas-api-e2e-shared-b-d57d53-serving-cert" not found
Jul 07 19:19:00.541659 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:19:00.541648    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls podName:d38474f3-5398-44d4-8770-7b52f5444e7e nodeName:}" failed. No retries permitted until 2026-07-07 19:19:01.041631039 +0000 UTC m=+2091.595522502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls") pod "maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8" (UID: "d38474f3-5398-44d4-8770-7b52f5444e7e") : secret "maas-api-e2e-shared-b-d57d53-serving-cert" not found
Jul 07 19:19:00.542080 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.542064    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38474f3-5398-44d4-8770-7b52f5444e7e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:00.552009 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:00.551983    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbsrq\" (UniqueName: \"kubernetes.io/projected/d38474f3-5398-44d4-8770-7b52f5444e7e-kube-api-access-tbsrq\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:01.045480 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:01.045444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:01.047947 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:01.047918    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") " pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:01.179308 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:01.179269    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:19:01.246963 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:01.246930    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:01.387813 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:01.387789    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"]
Jul 07 19:19:01.389758 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:19:01.389731    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38474f3_5398_44d4_8770_7b52f5444e7e.slice/crio-44096fa4013fca2cf790f780588f8b9624bbbf0bd91aa17a1a398622cde2f655 WatchSource:0}: Error finding container 44096fa4013fca2cf790f780588f8b9624bbbf0bd91aa17a1a398622cde2f655: Status 404 returned error can't find the container with id 44096fa4013fca2cf790f780588f8b9624bbbf0bd91aa17a1a398622cde2f655
Jul 07 19:19:01.448136 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:01.448112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8" event={"ID":"d38474f3-5398-44d4-8770-7b52f5444e7e","Type":"ContainerStarted","Data":"44096fa4013fca2cf790f780588f8b9624bbbf0bd91aa17a1a398622cde2f655"}
Jul 07 19:19:02.454540 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:02.454503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8" event={"ID":"d38474f3-5398-44d4-8770-7b52f5444e7e","Type":"ContainerStarted","Data":"4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0"}
Jul 07 19:19:02.454892 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:02.454651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:02.475913 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:02.475858    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8" podStartSLOduration=1.926320804 podStartE2EDuration="2.475837291s" totalImagesPullingTime="549.516487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:02.47541959 +0000 UTC m=+2093.029311077" watchObservedRunningTime="2026-07-07 19:19:02.475837291 +0000 UTC m=+2093.029728777"
Jul 07 19:19:08.464615 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:08.464588    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:19:11.378388 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:11.378352    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:19:22.556232 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.556189    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"]
Jul 07 19:19:22.559483 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.559460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.563016 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.562994    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"openshift-service-ca.crt\""
Jul 07 19:19:22.563127 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.563008    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"auth-test-model-dedce5-kserve-self-signed-certs\""
Jul 07 19:19:22.563127 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.562995    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"default-dockercfg-6w8cd\""
Jul 07 19:19:22.563127 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.563026    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"kube-root-ca.crt\""
Jul 07 19:19:22.571272 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.571235    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"]
Jul 07 19:19:22.620339 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.620308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2853675-c3d8-4fbb-ab66-2f554615b243-tls-certs\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.620542 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.620354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-dshm\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.620542 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.620381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-model-cache\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.620542 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.620404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-home\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.620542 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.620428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-tmp-dir\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.620542 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.620447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mss2\" (UniqueName: \"kubernetes.io/projected/b2853675-c3d8-4fbb-ab66-2f554615b243-kube-api-access-7mss2\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721099 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2853675-c3d8-4fbb-ab66-2f554615b243-tls-certs\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721412 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-dshm\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721412 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-model-cache\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721412 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-home\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721412 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-tmp-dir\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721412 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mss2\" (UniqueName: \"kubernetes.io/projected/b2853675-c3d8-4fbb-ab66-2f554615b243-kube-api-access-7mss2\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721731 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721618    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-home\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721731 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721661    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-tmp-dir\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.721731 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.721708    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-model-cache\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.723509 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.723482    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-dshm\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.723712 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.723693    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2853675-c3d8-4fbb-ab66-2f554615b243-tls-certs\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.730594 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.730575    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mss2\" (UniqueName: \"kubernetes.io/projected/b2853675-c3d8-4fbb-ab66-2f554615b243-kube-api-access-7mss2\") pod \"auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") " pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:22.867993 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:22.867904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:23.002360 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:23.002296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"]
Jul 07 19:19:23.004549 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:19:23.004522    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2853675_c3d8_4fbb_ab66_2f554615b243.slice/crio-103f2d2c5897b7f605061fe57d13c6e61535ab0d5508228178dfba4a33750d44 WatchSource:0}: Error finding container 103f2d2c5897b7f605061fe57d13c6e61535ab0d5508228178dfba4a33750d44: Status 404 returned error can't find the container with id 103f2d2c5897b7f605061fe57d13c6e61535ab0d5508228178dfba4a33750d44
Jul 07 19:19:23.542580 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:23.542539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4" event={"ID":"b2853675-c3d8-4fbb-ab66-2f554615b243","Type":"ContainerStarted","Data":"040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe"}
Jul 07 19:19:23.542580 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:23.542579    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4" event={"ID":"b2853675-c3d8-4fbb-ab66-2f554615b243","Type":"ContainerStarted","Data":"103f2d2c5897b7f605061fe57d13c6e61535ab0d5508228178dfba4a33750d44"}
Jul 07 19:19:23.571761 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:23.571704    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4" podStartSLOduration=1.5716883419999998 podStartE2EDuration="1.571688342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:23.570565972 +0000 UTC m=+2114.124457458" watchObservedRunningTime="2026-07-07 19:19:23.571688342 +0000 UTC m=+2114.125579833"
Jul 07 19:19:25.581214 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:25.581183    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:19:32.868212 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:32.868180    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:32.868606 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:32.868223    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:32.880449 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:32.880428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:33.597751 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:33.597725    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:19:44.170966 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.170934    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"]
Jul 07 19:19:44.175409 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.175386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.179239 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.179219    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"auth-test-model-d57d53-kserve-self-signed-certs\""
Jul 07 19:19:44.180121 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.180103    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"openshift-service-ca.crt\""
Jul 07 19:19:44.180201 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.180119    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"kube-root-ca.crt\""
Jul 07 19:19:44.180201 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.180110    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"default-dockercfg-sdq9q\""
Jul 07 19:19:44.190924 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.190903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"]
Jul 07 19:19:44.283522 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.283492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tmp-dir\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.283655 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.283529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-model-cache\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.283655 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.283623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-dshm\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.283730 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.283658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-home\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.283765 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.283727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tls-certs\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.283765 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.283755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmqwr\" (UniqueName: \"kubernetes.io/projected/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-kube-api-access-jmqwr\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.384906 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.384869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-dshm\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385034 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.384914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-home\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385034 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.384960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tls-certs\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385034 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.384980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmqwr\" (UniqueName: \"kubernetes.io/projected/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-kube-api-access-jmqwr\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385034 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.385002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tmp-dir\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385232 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.385156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-model-cache\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385423 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.385400    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tmp-dir\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385549 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.385449    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-home\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.385615 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.385588    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-model-cache\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.387344 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.387326    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-dshm\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.387479 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.387461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tls-certs\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.394847 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.394821    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmqwr\" (UniqueName: \"kubernetes.io/projected/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-kube-api-access-jmqwr\") pod \"auth-test-model-d57d53-kserve-5fdb64f955-spgzr\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") " pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.484640 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.484618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:44.616080 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.616056    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"]
Jul 07 19:19:44.618117 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:19:44.618086    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd4a7e90_3e4d_4c31_8ba0_10ae6d1869f6.slice/crio-6778144d8bfaf6a432b160731c110bbd44ec878fae85f8ff4be6c3996fd1160d WatchSource:0}: Error finding container 6778144d8bfaf6a432b160731c110bbd44ec878fae85f8ff4be6c3996fd1160d: Status 404 returned error can't find the container with id 6778144d8bfaf6a432b160731c110bbd44ec878fae85f8ff4be6c3996fd1160d
Jul 07 19:19:44.636304 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:44.636279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr" event={"ID":"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6","Type":"ContainerStarted","Data":"6778144d8bfaf6a432b160731c110bbd44ec878fae85f8ff4be6c3996fd1160d"}
Jul 07 19:19:45.642420 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:45.642385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr" event={"ID":"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6","Type":"ContainerStarted","Data":"8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b"}
Jul 07 19:19:45.662742 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:45.662689    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr" podStartSLOduration=1.662670825 podStartE2EDuration="1.662670825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:45.662431188 +0000 UTC m=+2136.216322674" watchObservedRunningTime="2026-07-07 19:19:45.662670825 +0000 UTC m=+2136.216562314"
Jul 07 19:19:47.299281 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:47.294985    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:19:54.485383 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:54.485344    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:54.485383 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:54.485395    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:54.498136 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:54.498108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:19:54.690065 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:19:54.690032    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:20:11.081559 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:20:11.081486    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:20:28.184584 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:20:28.184552    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:20:41.890989 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:20:41.890955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:20:59.095195 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:20:59.095156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:21:12.479622 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:12.479586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:21:27.195844 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:27.195811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:21:40.558534 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:40.558458    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"]
Jul 07 19:21:41.361496 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:41.361459    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"]
Jul 07 19:21:44.381199 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:44.381155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:21:55.577991 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.577929    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4" podUID="b2853675-c3d8-4fbb-ab66-2f554615b243" containerName="main" containerID="cri-o://040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe" gracePeriod=45
Jul 07 19:21:55.834565 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.834504    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:21:55.993549 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993516    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-home\") pod \"b2853675-c3d8-4fbb-ab66-2f554615b243\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") "
Jul 07 19:21:55.993740 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993566    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-dshm\") pod \"b2853675-c3d8-4fbb-ab66-2f554615b243\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") "
Jul 07 19:21:55.993740 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-tmp-dir\") pod \"b2853675-c3d8-4fbb-ab66-2f554615b243\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") "
Jul 07 19:21:55.993740 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993620    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mss2\" (UniqueName: \"kubernetes.io/projected/b2853675-c3d8-4fbb-ab66-2f554615b243-kube-api-access-7mss2\") pod \"b2853675-c3d8-4fbb-ab66-2f554615b243\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") "
Jul 07 19:21:55.993740 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993642    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2853675-c3d8-4fbb-ab66-2f554615b243-tls-certs\") pod \"b2853675-c3d8-4fbb-ab66-2f554615b243\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") "
Jul 07 19:21:55.993740 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993680    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-model-cache\") pod \"b2853675-c3d8-4fbb-ab66-2f554615b243\" (UID: \"b2853675-c3d8-4fbb-ab66-2f554615b243\") "
Jul 07 19:21:55.994013 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993849    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-home" (OuterVolumeSpecName: "home") pod "b2853675-c3d8-4fbb-ab66-2f554615b243" (UID: "b2853675-c3d8-4fbb-ab66-2f554615b243"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:55.994013 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993930    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2853675-c3d8-4fbb-ab66-2f554615b243" (UID: "b2853675-c3d8-4fbb-ab66-2f554615b243"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:55.994013 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.993992    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2853675-c3d8-4fbb-ab66-2f554615b243" (UID: "b2853675-c3d8-4fbb-ab66-2f554615b243"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:55.995836 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.995806    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-dshm" (OuterVolumeSpecName: "dshm") pod "b2853675-c3d8-4fbb-ab66-2f554615b243" (UID: "b2853675-c3d8-4fbb-ab66-2f554615b243"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:55.995931 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.995845    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2853675-c3d8-4fbb-ab66-2f554615b243-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2853675-c3d8-4fbb-ab66-2f554615b243" (UID: "b2853675-c3d8-4fbb-ab66-2f554615b243"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:21:55.995931 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:55.995871    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2853675-c3d8-4fbb-ab66-2f554615b243-kube-api-access-7mss2" (OuterVolumeSpecName: "kube-api-access-7mss2") pod "b2853675-c3d8-4fbb-ab66-2f554615b243" (UID: "b2853675-c3d8-4fbb-ab66-2f554615b243"). InnerVolumeSpecName "kube-api-access-7mss2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:21:56.094566 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.094450    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.094566 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.094495    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.094566 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.094507    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.094566 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.094523    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mss2\" (UniqueName: \"kubernetes.io/projected/b2853675-c3d8-4fbb-ab66-2f554615b243-kube-api-access-7mss2\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.094566 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.094534    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2853675-c3d8-4fbb-ab66-2f554615b243-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.094566 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.094547    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2853675-c3d8-4fbb-ab66-2f554615b243-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.200157 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.200121    2581 generic.go:356] "Generic (PLEG): container finished" podID="b2853675-c3d8-4fbb-ab66-2f554615b243" containerID="040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe" exitCode=0
Jul 07 19:21:56.200329 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.200174    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"
Jul 07 19:21:56.200329 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.200203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4" event={"ID":"b2853675-c3d8-4fbb-ab66-2f554615b243","Type":"ContainerDied","Data":"040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe"}
Jul 07 19:21:56.200329 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.200239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4" event={"ID":"b2853675-c3d8-4fbb-ab66-2f554615b243","Type":"ContainerDied","Data":"103f2d2c5897b7f605061fe57d13c6e61535ab0d5508228178dfba4a33750d44"}
Jul 07 19:21:56.200329 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.200276    2581 scope.go:117] "RemoveContainer" containerID="040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe"
Jul 07 19:21:56.208885 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.208869    2581 scope.go:117] "RemoveContainer" containerID="040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe"
Jul 07 19:21:56.209135 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:21:56.209116    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe\": container with ID starting with 040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe not found: ID does not exist" containerID="040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe"
Jul 07 19:21:56.209184 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.209143    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe"} err="failed to get container status \"040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe\": rpc error: code = NotFound desc = could not find container \"040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe\": container with ID starting with 040fd1829cbd1564f76bff205e3b82887e98e0030716c2999d9f7abb9b7cfcfe not found: ID does not exist"
Jul 07 19:21:56.224539 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.224512    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"]
Jul 07 19:21:56.233507 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.233483    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/auth-test-model-dedce5-kserve-66d78cf8c9-fv2p4"]
Jul 07 19:21:56.381222 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.381131    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr" podUID="bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" containerName="main" containerID="cri-o://8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b" gracePeriod=45
Jul 07 19:21:56.636418 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.636351    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:21:56.802449 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802414    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tmp-dir\") pod \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") "
Jul 07 19:21:56.802625 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802464    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-model-cache\") pod \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") "
Jul 07 19:21:56.802625 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-dshm\") pod \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") "
Jul 07 19:21:56.802625 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802545    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-home\") pod \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") "
Jul 07 19:21:56.802625 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802588    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmqwr\" (UniqueName: \"kubernetes.io/projected/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-kube-api-access-jmqwr\") pod \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") "
Jul 07 19:21:56.802831 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802629    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tls-certs\") pod \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\" (UID: \"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6\") "
Jul 07 19:21:56.802831 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802737    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" (UID: "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:56.802831 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802744    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" (UID: "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:56.802831 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802778    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-home" (OuterVolumeSpecName: "home") pod "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" (UID: "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:56.803013 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802892    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.803013 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802906    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.803013 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.802915    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.804815 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.804793    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-dshm" (OuterVolumeSpecName: "dshm") pod "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" (UID: "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:56.804900 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.804817    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-kube-api-access-jmqwr" (OuterVolumeSpecName: "kube-api-access-jmqwr") pod "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" (UID: "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6"). InnerVolumeSpecName "kube-api-access-jmqwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:21:56.804900 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.804857    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" (UID: "bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:21:56.903670 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.903584    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.903670 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.903617    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmqwr\" (UniqueName: \"kubernetes.io/projected/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-kube-api-access-jmqwr\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:56.903670 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:56.903632    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:21:57.206780 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.206687    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" containerID="8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b" exitCode=0
Jul 07 19:21:57.206780 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.206730    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"
Jul 07 19:21:57.206780 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.206768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr" event={"ID":"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6","Type":"ContainerDied","Data":"8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b"}
Jul 07 19:21:57.207066 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.206813    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr" event={"ID":"bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6","Type":"ContainerDied","Data":"6778144d8bfaf6a432b160731c110bbd44ec878fae85f8ff4be6c3996fd1160d"}
Jul 07 19:21:57.207066 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.206833    2581 scope.go:117] "RemoveContainer" containerID="8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b"
Jul 07 19:21:57.218770 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.218748    2581 scope.go:117] "RemoveContainer" containerID="8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b"
Jul 07 19:21:57.219036 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:21:57.219019    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b\": container with ID starting with 8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b not found: ID does not exist" containerID="8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b"
Jul 07 19:21:57.219079 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.219046    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b"} err="failed to get container status \"8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b\": rpc error: code = NotFound desc = could not find container \"8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b\": container with ID starting with 8df962978e0687feefb44c583df76054af2b6d919700e3a46fbbedc6b1d97e4b not found: ID does not exist"
Jul 07 19:21:57.235643 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.235613    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"]
Jul 07 19:21:57.241187 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.241165    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/auth-test-model-d57d53-kserve-5fdb64f955-spgzr"]
Jul 07 19:21:57.946732 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.946700    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2853675-c3d8-4fbb-ab66-2f554615b243" path="/var/lib/kubelet/pods/b2853675-c3d8-4fbb-ab66-2f554615b243/volumes"
Jul 07 19:21:57.947100 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:21:57.947064    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" path="/var/lib/kubelet/pods/bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6/volumes"
Jul 07 19:22:06.047806 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.047768    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"]
Jul 07 19:22:06.048165 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.048088    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2853675-c3d8-4fbb-ab66-2f554615b243" containerName="main"
Jul 07 19:22:06.048165 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.048099    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2853675-c3d8-4fbb-ab66-2f554615b243" containerName="main"
Jul 07 19:22:06.048165 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.048113    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" containerName="main"
Jul 07 19:22:06.048165 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.048118    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" containerName="main"
Jul 07 19:22:06.048333 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.048172    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4a7e90-3e4d-4c31-8ba0-10ae6d1869f6" containerName="main"
Jul 07 19:22:06.048333 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.048183    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2853675-c3d8-4fbb-ab66-2f554615b243" containerName="main"
Jul 07 19:22:06.052222 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.052203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.055568 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.055544    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"openshift-service-ca.crt\""
Jul 07 19:22:06.055568 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.055545    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"kube-root-ca.crt\""
Jul 07 19:22:06.055769 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.055647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"default-dockercfg-6w8cd\""
Jul 07 19:22:06.055769 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.055667    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dedce5\"/\"sub-test-model-dedce5-kserve-self-signed-certs\""
Jul 07 19:22:06.064804 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.064779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"]
Jul 07 19:22:06.180464 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.180423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-dshm\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.180464 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.180460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-home\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.180706 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.180482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-tmp-dir\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.180706 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.180600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9f4f812-f5f3-401b-b50e-448188261243-tls-certs\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.180706 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.180644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-model-cache\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.180706 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.180693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gsw8\" (UniqueName: \"kubernetes.io/projected/a9f4f812-f5f3-401b-b50e-448188261243-kube-api-access-7gsw8\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.281569 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.281517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9f4f812-f5f3-401b-b50e-448188261243-tls-certs\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.281761 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.281597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-model-cache\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.281761 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.281633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gsw8\" (UniqueName: \"kubernetes.io/projected/a9f4f812-f5f3-401b-b50e-448188261243-kube-api-access-7gsw8\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.281863 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.281769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-dshm\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.281863 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.281811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-home\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.281863 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.281836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-tmp-dir\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.282073 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.282046    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-model-cache\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.282210 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.282139    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-home\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.282300 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.282222    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-tmp-dir\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.283952 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.283929    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-dshm\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.284191 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.284174    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9f4f812-f5f3-401b-b50e-448188261243-tls-certs\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.290892 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.290867    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gsw8\" (UniqueName: \"kubernetes.io/projected/a9f4f812-f5f3-401b-b50e-448188261243-kube-api-access-7gsw8\") pod \"sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") " pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.361435 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.361339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:06.497134 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:06.497106    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"]
Jul 07 19:22:06.499833 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:22:06.499799    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9f4f812_f5f3_401b_b50e_448188261243.slice/crio-45b6086a9da83eb4f1e643e73d86223fe89d915304b8608567cd91f05da2398b WatchSource:0}: Error finding container 45b6086a9da83eb4f1e643e73d86223fe89d915304b8608567cd91f05da2398b: Status 404 returned error can't find the container with id 45b6086a9da83eb4f1e643e73d86223fe89d915304b8608567cd91f05da2398b
Jul 07 19:22:07.251371 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:07.251338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq" event={"ID":"a9f4f812-f5f3-401b-b50e-448188261243","Type":"ContainerStarted","Data":"800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4"}
Jul 07 19:22:07.251371 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:07.251376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq" event={"ID":"a9f4f812-f5f3-401b-b50e-448188261243","Type":"ContainerStarted","Data":"45b6086a9da83eb4f1e643e73d86223fe89d915304b8608567cd91f05da2398b"}
Jul 07 19:22:07.284213 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:07.284140    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq" podStartSLOduration=1.284117878 podStartE2EDuration="1.284117878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:22:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:22:07.283441852 +0000 UTC m=+2277.837333339" watchObservedRunningTime="2026-07-07 19:22:07.284117878 +0000 UTC m=+2277.838009365"
Jul 07 19:22:09.886541 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:09.886510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:22:16.361927 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:16.361887    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:16.361927 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:16.361937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:16.375655 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:16.375628    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:17.304168 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:17.304141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:22:22.045334 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.045301    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"]
Jul 07 19:22:22.048453 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.048432    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.050928 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.050907    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"sub-test-model-d57d53-kserve-self-signed-certs\""
Jul 07 19:22:22.051873 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.051855    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"openshift-service-ca.crt\""
Jul 07 19:22:22.051985 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.051943    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"default-dockercfg-sdq9q\""
Jul 07 19:22:22.052054 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.052009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"kube-root-ca.crt\""
Jul 07 19:22:22.061512 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.061490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"]
Jul 07 19:22:22.103735 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.103699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnblt\" (UniqueName: \"kubernetes.io/projected/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-kube-api-access-lnblt\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.103887 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.103747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tmp-dir\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.103887 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.103776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-home\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.103887 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.103825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-model-cache\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.103887 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.103856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tls-certs\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.104046 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.103905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-dshm\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205199 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnblt\" (UniqueName: \"kubernetes.io/projected/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-kube-api-access-lnblt\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205357 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tmp-dir\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205357 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-home\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205357 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-model-cache\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205357 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tls-certs\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205357 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-dshm\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205681 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205656    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tmp-dir\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205760 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205671    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-model-cache\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.205760 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.205742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-home\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.207659 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.207630    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-dshm\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.208042 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.208020    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tls-certs\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.220577 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.220549    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnblt\" (UniqueName: \"kubernetes.io/projected/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-kube-api-access-lnblt\") pod \"sub-test-model-d57d53-kserve-86ccf5b679-h7ntb\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") " pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.357885 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.357804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:22.494609 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:22.494577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"]
Jul 07 19:22:22.497649 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:22:22.497623    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef417117_ce73_4e46_99f1_1c5d3df3bf1f.slice/crio-fc282acc3467b5a445dcf8435de168255005b6ec2a8414d32a89c1cbbc879315 WatchSource:0}: Error finding container fc282acc3467b5a445dcf8435de168255005b6ec2a8414d32a89c1cbbc879315: Status 404 returned error can't find the container with id fc282acc3467b5a445dcf8435de168255005b6ec2a8414d32a89c1cbbc879315
Jul 07 19:22:23.319241 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:23.319210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb" event={"ID":"ef417117-ce73-4e46-99f1-1c5d3df3bf1f","Type":"ContainerStarted","Data":"27a2ac512be014125faddc40194834f90767d4bb82cbec798e019c63a537f2f5"}
Jul 07 19:22:23.319652 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:23.319280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb" event={"ID":"ef417117-ce73-4e46-99f1-1c5d3df3bf1f","Type":"ContainerStarted","Data":"fc282acc3467b5a445dcf8435de168255005b6ec2a8414d32a89c1cbbc879315"}
Jul 07 19:22:23.338608 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:23.338550    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb" podStartSLOduration=1.338533287 podStartE2EDuration="1.338533287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:22:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:22:23.337235925 +0000 UTC m=+2293.891127457" watchObservedRunningTime="2026-07-07 19:22:23.338533287 +0000 UTC m=+2293.892424824"
Jul 07 19:22:28.790836 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:28.790798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:22:32.358734 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:32.358703    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:32.358734 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:32.358742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:32.371156 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:32.371129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:33.375349 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:33.375322    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:22:44.022792 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:44.022754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:22:59.084611 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:22:59.084571    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:23:03.483029 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:03.482951    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"]
Jul 07 19:23:04.402055 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:04.402023    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"]
Jul 07 19:23:14.977928 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:14.977889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:23:18.505049 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.505007    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq" podUID="a9f4f812-f5f3-401b-b50e-448188261243" containerName="main" containerID="cri-o://800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4" gracePeriod=45
Jul 07 19:23:18.754969 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.754946    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:23:18.777931 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.777853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-dshm\") pod \"a9f4f812-f5f3-401b-b50e-448188261243\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") "
Jul 07 19:23:18.778056 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.777932    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-model-cache\") pod \"a9f4f812-f5f3-401b-b50e-448188261243\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") "
Jul 07 19:23:18.778056 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.777967    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-tmp-dir\") pod \"a9f4f812-f5f3-401b-b50e-448188261243\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") "
Jul 07 19:23:18.778056 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.777991    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9f4f812-f5f3-401b-b50e-448188261243-tls-certs\") pod \"a9f4f812-f5f3-401b-b50e-448188261243\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") "
Jul 07 19:23:18.778056 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.778012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-home\") pod \"a9f4f812-f5f3-401b-b50e-448188261243\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") "
Jul 07 19:23:18.778231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.778059    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gsw8\" (UniqueName: \"kubernetes.io/projected/a9f4f812-f5f3-401b-b50e-448188261243-kube-api-access-7gsw8\") pod \"a9f4f812-f5f3-401b-b50e-448188261243\" (UID: \"a9f4f812-f5f3-401b-b50e-448188261243\") "
Jul 07 19:23:18.778449 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.778407    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a9f4f812-f5f3-401b-b50e-448188261243" (UID: "a9f4f812-f5f3-401b-b50e-448188261243"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:18.778626 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.778599    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-model-cache" (OuterVolumeSpecName: "model-cache") pod "a9f4f812-f5f3-401b-b50e-448188261243" (UID: "a9f4f812-f5f3-401b-b50e-448188261243"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:18.779032 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.778995    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-home" (OuterVolumeSpecName: "home") pod "a9f4f812-f5f3-401b-b50e-448188261243" (UID: "a9f4f812-f5f3-401b-b50e-448188261243"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:18.780738 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.780705    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-dshm" (OuterVolumeSpecName: "dshm") pod "a9f4f812-f5f3-401b-b50e-448188261243" (UID: "a9f4f812-f5f3-401b-b50e-448188261243"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:18.780738 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.780715    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f4f812-f5f3-401b-b50e-448188261243-kube-api-access-7gsw8" (OuterVolumeSpecName: "kube-api-access-7gsw8") pod "a9f4f812-f5f3-401b-b50e-448188261243" (UID: "a9f4f812-f5f3-401b-b50e-448188261243"). InnerVolumeSpecName "kube-api-access-7gsw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:18.781033 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.781010    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f4f812-f5f3-401b-b50e-448188261243-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a9f4f812-f5f3-401b-b50e-448188261243" (UID: "a9f4f812-f5f3-401b-b50e-448188261243"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:23:18.879384 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.879340    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gsw8\" (UniqueName: \"kubernetes.io/projected/a9f4f812-f5f3-401b-b50e-448188261243-kube-api-access-7gsw8\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:18.879384 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.879378    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:18.879384 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.879390    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:18.879612 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.879419    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:18.879612 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.879427    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9f4f812-f5f3-401b-b50e-448188261243-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:18.879612 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:18.879434    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9f4f812-f5f3-401b-b50e-448188261243-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:19.422011 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.421974    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb" podUID="ef417117-ce73-4e46-99f1-1c5d3df3bf1f" containerName="main" containerID="cri-o://27a2ac512be014125faddc40194834f90767d4bb82cbec798e019c63a537f2f5" gracePeriod=45
Jul 07 19:23:19.564649 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.564607    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9f4f812-f5f3-401b-b50e-448188261243" containerID="800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4" exitCode=0
Jul 07 19:23:19.564649 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.564650    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"
Jul 07 19:23:19.565118 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.564702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq" event={"ID":"a9f4f812-f5f3-401b-b50e-448188261243","Type":"ContainerDied","Data":"800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4"}
Jul 07 19:23:19.565118 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.564753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq" event={"ID":"a9f4f812-f5f3-401b-b50e-448188261243","Type":"ContainerDied","Data":"45b6086a9da83eb4f1e643e73d86223fe89d915304b8608567cd91f05da2398b"}
Jul 07 19:23:19.565118 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.564778    2581 scope.go:117] "RemoveContainer" containerID="800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4"
Jul 07 19:23:19.566873 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.566851    2581 generic.go:356] "Generic (PLEG): container finished" podID="ef417117-ce73-4e46-99f1-1c5d3df3bf1f" containerID="27a2ac512be014125faddc40194834f90767d4bb82cbec798e019c63a537f2f5" exitCode=0
Jul 07 19:23:19.566982 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.566886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb" event={"ID":"ef417117-ce73-4e46-99f1-1c5d3df3bf1f","Type":"ContainerDied","Data":"27a2ac512be014125faddc40194834f90767d4bb82cbec798e019c63a537f2f5"}
Jul 07 19:23:19.574738 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.574725    2581 scope.go:117] "RemoveContainer" containerID="800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4"
Jul 07 19:23:19.574978 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:23:19.574958    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4\": container with ID starting with 800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4 not found: ID does not exist" containerID="800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4"
Jul 07 19:23:19.575041 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.574999    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4"} err="failed to get container status \"800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4\": rpc error: code = NotFound desc = could not find container \"800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4\": container with ID starting with 800a8eb76664d22716dd883ac5073b691376f3077f8962988a35dff7d0f017a4 not found: ID does not exist"
Jul 07 19:23:19.590947 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.590924    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"]
Jul 07 19:23:19.595562 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.595539    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dedce5/sub-test-model-dedce5-kserve-78cb7cd9bc-k9nxq"]
Jul 07 19:23:19.668802 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.668780    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:23:19.687555 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687502    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-model-cache\") pod \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") "
Jul 07 19:23:19.687555 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tls-certs\") pod \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") "
Jul 07 19:23:19.687743 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tmp-dir\") pod \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") "
Jul 07 19:23:19.687743 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687618    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnblt\" (UniqueName: \"kubernetes.io/projected/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-kube-api-access-lnblt\") pod \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") "
Jul 07 19:23:19.687743 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687634    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-dshm\") pod \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") "
Jul 07 19:23:19.687743 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687657    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-home\") pod \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\" (UID: \"ef417117-ce73-4e46-99f1-1c5d3df3bf1f\") "
Jul 07 19:23:19.687941 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687778    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef417117-ce73-4e46-99f1-1c5d3df3bf1f" (UID: "ef417117-ce73-4e46-99f1-1c5d3df3bf1f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:19.687941 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687854    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef417117-ce73-4e46-99f1-1c5d3df3bf1f" (UID: "ef417117-ce73-4e46-99f1-1c5d3df3bf1f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:19.687941 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687894    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:19.688076 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.687953    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-home" (OuterVolumeSpecName: "home") pod "ef417117-ce73-4e46-99f1-1c5d3df3bf1f" (UID: "ef417117-ce73-4e46-99f1-1c5d3df3bf1f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:19.689990 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.689966    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef417117-ce73-4e46-99f1-1c5d3df3bf1f" (UID: "ef417117-ce73-4e46-99f1-1c5d3df3bf1f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:23:19.690112 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.690042    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-kube-api-access-lnblt" (OuterVolumeSpecName: "kube-api-access-lnblt") pod "ef417117-ce73-4e46-99f1-1c5d3df3bf1f" (UID: "ef417117-ce73-4e46-99f1-1c5d3df3bf1f"). InnerVolumeSpecName "kube-api-access-lnblt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:19.690160 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.690109    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-dshm" (OuterVolumeSpecName: "dshm") pod "ef417117-ce73-4e46-99f1-1c5d3df3bf1f" (UID: "ef417117-ce73-4e46-99f1-1c5d3df3bf1f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:19.789162 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.789135    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:19.789162 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.789159    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:19.789162 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.789170    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:19.789393 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.789182    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnblt\" (UniqueName: \"kubernetes.io/projected/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-kube-api-access-lnblt\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:19.789393 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.789193    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef417117-ce73-4e46-99f1-1c5d3df3bf1f-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:23:19.947740 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:19.947657    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f4f812-f5f3-401b-b50e-448188261243" path="/var/lib/kubelet/pods/a9f4f812-f5f3-401b-b50e-448188261243/volumes"
Jul 07 19:23:20.572686 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:20.572656    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"
Jul 07 19:23:20.573192 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:20.572688    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb" event={"ID":"ef417117-ce73-4e46-99f1-1c5d3df3bf1f","Type":"ContainerDied","Data":"fc282acc3467b5a445dcf8435de168255005b6ec2a8414d32a89c1cbbc879315"}
Jul 07 19:23:20.573192 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:20.572732    2581 scope.go:117] "RemoveContainer" containerID="27a2ac512be014125faddc40194834f90767d4bb82cbec798e019c63a537f2f5"
Jul 07 19:23:20.592836 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:20.592811    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"]
Jul 07 19:23:20.598025 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:20.598002    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/sub-test-model-d57d53-kserve-86ccf5b679-h7ntb"]
Jul 07 19:23:21.947025 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:21.946992    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef417117-ce73-4e46-99f1-1c5d3df3bf1f" path="/var/lib/kubelet/pods/ef417117-ce73-4e46-99f1-1c5d3df3bf1f/volumes"
Jul 07 19:23:37.741888 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.741859    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"]
Jul 07 19:23:37.742247 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.742149    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f4f812-f5f3-401b-b50e-448188261243" containerName="main"
Jul 07 19:23:37.742247 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.742160    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f4f812-f5f3-401b-b50e-448188261243" containerName="main"
Jul 07 19:23:37.742247 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.742173    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef417117-ce73-4e46-99f1-1c5d3df3bf1f" containerName="main"
Jul 07 19:23:37.742247 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.742179    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef417117-ce73-4e46-99f1-1c5d3df3bf1f" containerName="main"
Jul 07 19:23:37.742247 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.742232    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f4f812-f5f3-401b-b50e-448188261243" containerName="main"
Jul 07 19:23:37.742247 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.742240    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef417117-ce73-4e46-99f1-1c5d3df3bf1f" containerName="main"
Jul 07 19:23:37.746495 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.746478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.751903 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.749194    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"kube-root-ca.crt\""
Jul 07 19:23:37.751903 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.750173    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"rate-test-model-d57d53-kserve-self-signed-certs\""
Jul 07 19:23:37.751903 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.750185    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"openshift-service-ca.crt\""
Jul 07 19:23:37.751903 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.750491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d57d53\"/\"default-dockercfg-sdq9q\""
Jul 07 19:23:37.756830 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.756806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"]
Jul 07 19:23:37.837465 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.837435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tls-certs\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.837611 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.837476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tmp-dir\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.837611 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.837493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmn2v\" (UniqueName: \"kubernetes.io/projected/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-kube-api-access-bmn2v\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.837687 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.837599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-dshm\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.837687 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.837638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-model-cache\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.837687 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.837680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-home\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.938816 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.938781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-dshm\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.938986 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.938827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-model-cache\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.938986 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.938858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-home\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.938986 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.938890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tls-certs\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.938986 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.938914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tmp-dir\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.938986 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.938930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn2v\" (UniqueName: \"kubernetes.io/projected/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-kube-api-access-bmn2v\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.939376 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.939341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-model-cache\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.939455 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.939359    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-home\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.939455 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.939398    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tmp-dir\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.941079 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.941060    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-dshm\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.941358 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.941341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tls-certs\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:37.949040 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:37.949021    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmn2v\" (UniqueName: \"kubernetes.io/projected/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-kube-api-access-bmn2v\") pod \"rate-test-model-d57d53-kserve-8485d4c895-2tgvc\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") " pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:38.058015 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:38.057930    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:38.195688 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:38.195559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"]
Jul 07 19:23:38.198076 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:23:38.198047    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd79cba22_b9aa_4d4d_bd1b_15a03a00b5cd.slice/crio-cc06a001aecca37a97486857bc0c19eac7298c52e5a1ee279f671cd3322e15bb WatchSource:0}: Error finding container cc06a001aecca37a97486857bc0c19eac7298c52e5a1ee279f671cd3322e15bb: Status 404 returned error can't find the container with id cc06a001aecca37a97486857bc0c19eac7298c52e5a1ee279f671cd3322e15bb
Jul 07 19:23:38.652137 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:38.652097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc" event={"ID":"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd","Type":"ContainerStarted","Data":"8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d"}
Jul 07 19:23:38.652137 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:38.652137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc" event={"ID":"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd","Type":"ContainerStarted","Data":"cc06a001aecca37a97486857bc0c19eac7298c52e5a1ee279f671cd3322e15bb"}
Jul 07 19:23:38.683959 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:38.683908    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc" podStartSLOduration=1.683893704 podStartE2EDuration="1.683893704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:38.68164912 +0000 UTC m=+2369.235540605" watchObservedRunningTime="2026-07-07 19:23:38.683893704 +0000 UTC m=+2369.237785193"
Jul 07 19:23:41.476289 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:41.476260    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:23:48.058448 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:48.058418    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:48.058448 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:48.058457    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:48.070673 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:48.070652    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:23:48.706506 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:23:48.706473    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:24:03.881737 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:03.881672    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:24:17.580214 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:17.580180    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:24:26.435757 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:26.435722    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"]
Jul 07 19:24:28.371790 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.371757    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"]
Jul 07 19:24:28.372267 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.372104    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls" podUID="1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" containerName="maas-api" containerID="cri-o://d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611" gracePeriod=30
Jul 07 19:24:28.615823 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.615797    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:24:28.640284 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.640199    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-openshift-service-ca\") pod \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") "
Jul 07 19:24:28.640284 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.640263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhxmw\" (UniqueName: \"kubernetes.io/projected/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-kube-api-access-qhxmw\") pod \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") "
Jul 07 19:24:28.640446 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.640354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls\") pod \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\" (UID: \"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d\") "
Jul 07 19:24:28.640552 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.640530    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" (UID: "1fff0ec4-ef58-4274-99e4-9c5fbaaa721d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:24:28.642381 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.642355    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" (UID: "1fff0ec4-ef58-4274-99e4-9c5fbaaa721d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:24:28.642614 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.642587    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-kube-api-access-qhxmw" (OuterVolumeSpecName: "kube-api-access-qhxmw") pod "1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" (UID: "1fff0ec4-ef58-4274-99e4-9c5fbaaa721d"). InnerVolumeSpecName "kube-api-access-qhxmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:24:28.741536 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.741507    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhxmw\" (UniqueName: \"kubernetes.io/projected/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-kube-api-access-qhxmw\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:28.741536 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.741532    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-maas-api-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:28.741536 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.741541    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d-openshift-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:28.864291 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.864244    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" containerID="d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611" exitCode=0
Jul 07 19:24:28.864453 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.864307    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"
Jul 07 19:24:28.864453 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.864339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls" event={"ID":"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d","Type":"ContainerDied","Data":"d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611"}
Jul 07 19:24:28.864453 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.864392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls" event={"ID":"1fff0ec4-ef58-4274-99e4-9c5fbaaa721d","Type":"ContainerDied","Data":"53cb251fcdf78977acde5b3ef0f7770536d34ac2d94d3fad8c2d05a322cf5bb5"}
Jul 07 19:24:28.864453 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.864413    2581 scope.go:117] "RemoveContainer" containerID="d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611"
Jul 07 19:24:28.872749 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.872735    2581 scope.go:117] "RemoveContainer" containerID="d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611"
Jul 07 19:24:28.872989 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:24:28.872969    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611\": container with ID starting with d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611 not found: ID does not exist" containerID="d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611"
Jul 07 19:24:28.873066 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.872996    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611"} err="failed to get container status \"d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611\": rpc error: code = NotFound desc = could not find container \"d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611\": container with ID starting with d6fb6ab37a7dd90cbdb9d20b10b47e70c7f7166717fdb65f883399c7d8d74611 not found: ID does not exist"
Jul 07 19:24:28.888472 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.888454    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"]
Jul 07 19:24:28.894857 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:28.894804    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-dedce5-6d5f6c7bf9-qbzls"]
Jul 07 19:24:29.946727 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:29.946693    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" path="/var/lib/kubelet/pods/1fff0ec4-ef58-4274-99e4-9c5fbaaa721d/volumes"
Jul 07 19:24:32.084813 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:32.084778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:24:41.455319 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.455276    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc" podUID="d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" containerName="main" containerID="cri-o://8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d" gracePeriod=45
Jul 07 19:24:41.702448 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.702412    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:24:41.746360 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746325    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tls-certs\") pod \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") "
Jul 07 19:24:41.746547 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746378    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tmp-dir\") pod \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") "
Jul 07 19:24:41.746547 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746409    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-model-cache\") pod \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") "
Jul 07 19:24:41.746669 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746576    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-dshm\") pod \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") "
Jul 07 19:24:41.746669 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmn2v\" (UniqueName: \"kubernetes.io/projected/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-kube-api-access-bmn2v\") pod \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") "
Jul 07 19:24:41.746669 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746643    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" (UID: "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:24:41.746819 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746666    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" (UID: "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:24:41.746819 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746739    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-home\") pod \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\" (UID: \"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd\") "
Jul 07 19:24:41.746971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746954    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tmp-dir\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:41.746971 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746961    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-home" (OuterVolumeSpecName: "home") pod "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" (UID: "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:24:41.747058 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.746975    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-model-cache\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:41.748632 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.748604    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" (UID: "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:24:41.748744 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.748649    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-dshm" (OuterVolumeSpecName: "dshm") pod "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" (UID: "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:24:41.748744 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.748668    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-kube-api-access-bmn2v" (OuterVolumeSpecName: "kube-api-access-bmn2v") pod "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" (UID: "d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd"). InnerVolumeSpecName "kube-api-access-bmn2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:24:41.847903 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.847871    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-tls-certs\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:41.847903 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.847900    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-dshm\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:41.848084 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.847914    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmn2v\" (UniqueName: \"kubernetes.io/projected/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-kube-api-access-bmn2v\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:41.848084 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.847928    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd-home\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:24:41.923478 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.923443    2581 generic.go:356] "Generic (PLEG): container finished" podID="d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" containerID="8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d" exitCode=0
Jul 07 19:24:41.923640 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.923493    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"
Jul 07 19:24:41.923640 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.923536    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc" event={"ID":"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd","Type":"ContainerDied","Data":"8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d"}
Jul 07 19:24:41.923640 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.923585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc" event={"ID":"d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd","Type":"ContainerDied","Data":"cc06a001aecca37a97486857bc0c19eac7298c52e5a1ee279f671cd3322e15bb"}
Jul 07 19:24:41.923640 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.923608    2581 scope.go:117] "RemoveContainer" containerID="8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d"
Jul 07 19:24:41.932343 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.932303    2581 scope.go:117] "RemoveContainer" containerID="8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d"
Jul 07 19:24:41.932586 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:24:41.932568    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d\": container with ID starting with 8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d not found: ID does not exist" containerID="8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d"
Jul 07 19:24:41.932633 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.932595    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d"} err="failed to get container status \"8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d\": rpc error: code = NotFound desc = could not find container \"8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d\": container with ID starting with 8daa11f61d34dc8ab002c78b0a47e80325a47806c2171518366e52738e36ef1d not found: ID does not exist"
Jul 07 19:24:41.950394 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.950373    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"]
Jul 07 19:24:41.953540 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:41.953520    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d57d53/rate-test-model-d57d53-kserve-8485d4c895-2tgvc"]
Jul 07 19:24:43.945736 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:24:43.945703    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" path="/var/lib/kubelet/pods/d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd/volumes"
Jul 07 19:25:12.965453 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:12.965418    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"]
Jul 07 19:25:12.967866 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:12.965611    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8" podUID="d38474f3-5398-44d4-8770-7b52f5444e7e" containerName="maas-api" containerID="cri-o://4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0" gracePeriod=30
Jul 07 19:25:13.204500 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.204471    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:25:13.294933 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.294900    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls\") pod \"d38474f3-5398-44d4-8770-7b52f5444e7e\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") "
Jul 07 19:25:13.294933 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.294937    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38474f3-5398-44d4-8770-7b52f5444e7e-openshift-service-ca\") pod \"d38474f3-5398-44d4-8770-7b52f5444e7e\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") "
Jul 07 19:25:13.295138 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.294971    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbsrq\" (UniqueName: \"kubernetes.io/projected/d38474f3-5398-44d4-8770-7b52f5444e7e-kube-api-access-tbsrq\") pod \"d38474f3-5398-44d4-8770-7b52f5444e7e\" (UID: \"d38474f3-5398-44d4-8770-7b52f5444e7e\") "
Jul 07 19:25:13.295337 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.295316    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d38474f3-5398-44d4-8770-7b52f5444e7e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d38474f3-5398-44d4-8770-7b52f5444e7e" (UID: "d38474f3-5398-44d4-8770-7b52f5444e7e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:25:13.297128 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.297095    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d38474f3-5398-44d4-8770-7b52f5444e7e" (UID: "d38474f3-5398-44d4-8770-7b52f5444e7e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:25:13.297206 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.297182    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d38474f3-5398-44d4-8770-7b52f5444e7e-kube-api-access-tbsrq" (OuterVolumeSpecName: "kube-api-access-tbsrq") pod "d38474f3-5398-44d4-8770-7b52f5444e7e" (UID: "d38474f3-5398-44d4-8770-7b52f5444e7e"). InnerVolumeSpecName "kube-api-access-tbsrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:25:13.396086 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.396055    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38474f3-5398-44d4-8770-7b52f5444e7e-maas-api-tls\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:25:13.396086 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.396081    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38474f3-5398-44d4-8770-7b52f5444e7e-openshift-service-ca\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:25:13.396295 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:13.396096    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbsrq\" (UniqueName: \"kubernetes.io/projected/d38474f3-5398-44d4-8770-7b52f5444e7e-kube-api-access-tbsrq\") on node \"ip-10-0-135-133.ec2.internal\" DevicePath \"\""
Jul 07 19:25:14.063328 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.063289    2581 generic.go:356] "Generic (PLEG): container finished" podID="d38474f3-5398-44d4-8770-7b52f5444e7e" containerID="4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0" exitCode=0
Jul 07 19:25:14.063328 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.063329    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"
Jul 07 19:25:14.063793 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.063331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8" event={"ID":"d38474f3-5398-44d4-8770-7b52f5444e7e","Type":"ContainerDied","Data":"4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0"}
Jul 07 19:25:14.063793 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.063460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8" event={"ID":"d38474f3-5398-44d4-8770-7b52f5444e7e","Type":"ContainerDied","Data":"44096fa4013fca2cf790f780588f8b9624bbbf0bd91aa17a1a398622cde2f655"}
Jul 07 19:25:14.063793 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.063485    2581 scope.go:117] "RemoveContainer" containerID="4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0"
Jul 07 19:25:14.073904 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.073882    2581 scope.go:117] "RemoveContainer" containerID="4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0"
Jul 07 19:25:14.074191 ip-10-0-135-133 kubenswrapper[2581]: E0707 19:25:14.074172    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0\": container with ID starting with 4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0 not found: ID does not exist" containerID="4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0"
Jul 07 19:25:14.074270 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.074199    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0"} err="failed to get container status \"4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0\": rpc error: code = NotFound desc = could not find container \"4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0\": container with ID starting with 4ad95994a8be1e5b0ee0cedb184b61b8915e49cf54adbc6507cc30694db8fcc0 not found: ID does not exist"
Jul 07 19:25:14.087965 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.087938    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"]
Jul 07 19:25:14.094617 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:14.094593    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d57d53-76bb895bbb-ljcn8"]
Jul 07 19:25:15.192839 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:15.192797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tp6qp"]
Jul 07 19:25:15.946053 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:15.946021    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d38474f3-5398-44d4-8770-7b52f5444e7e" path="/var/lib/kubelet/pods/d38474f3-5398-44d4-8770-7b52f5444e7e/volumes"
Jul 07 19:25:25.346106 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:25.346067    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724180-sfhjb_5e37c959-d790-4f1f-a93c-0b6081550696/cleanup/0.log"
Jul 07 19:25:25.457561 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:25.457531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724195-m7q7l_24e256e8-ba62-4072-a220-98a5552351bd/cleanup/0.log"
Jul 07 19:25:26.060970 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:26.060940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-jmlgg_bb86d2f3-39ed-4f03-9958-177f6946216e/copy-manifests/0.log"
Jul 07 19:25:26.069834 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:26.069806    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-jmlgg_bb86d2f3-39ed-4f03-9958-177f6946216e/manager/0.log"
Jul 07 19:25:26.303605 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:26.303565    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c8979_8c052fe2-7bca-461b-a18c-c64c26b8d58c/postgres/0.log"
Jul 07 19:25:28.090680 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:28.090651    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lcswn_81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06/registry-server/0.log"
Jul 07 19:25:28.216100 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:28.216070    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6bzss_ef4c40d3-e6a7-430a-99f7-6c5e2d49696a/manager/0.log"
Jul 07 19:25:28.336957 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:28.336912    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tp6qp_10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5/limitador/0.log"
Jul 07 19:25:30.090579 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:30.090536    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-t4lzz_817be2d8-a3ac-4ddd-84f5-a7e3ebd7479f/main/0.log"
Jul 07 19:25:30.435245 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:30.435169    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lzzp5_7e168d5f-4049-4c8a-b75a-94a61d40707c/main/0.log"
Jul 07 19:25:35.198671 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.198633    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sls4v/must-gather-mvwlk"]
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199022    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" containerName="maas-api"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199040    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" containerName="maas-api"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199059    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38474f3-5398-44d4-8770-7b52f5444e7e" containerName="maas-api"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199066    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38474f3-5398-44d4-8770-7b52f5444e7e" containerName="maas-api"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199093    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" containerName="main"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199102    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" containerName="main"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199176    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fff0ec4-ef58-4274-99e4-9c5fbaaa721d" containerName="maas-api"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199186    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79cba22-b9aa-4d4d-bd1b-15a03a00b5cd" containerName="main"
Jul 07 19:25:35.199231 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.199194    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38474f3-5398-44d4-8770-7b52f5444e7e" containerName="maas-api"
Jul 07 19:25:35.202338 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.202316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.204943 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.204924    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sls4v\"/\"openshift-service-ca.crt\""
Jul 07 19:25:35.205668 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.205650    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sls4v\"/\"kube-root-ca.crt\""
Jul 07 19:25:35.205766 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.205682    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sls4v\"/\"default-dockercfg-phqzb\""
Jul 07 19:25:35.219159 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.219139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sls4v/must-gather-mvwlk"]
Jul 07 19:25:35.370750 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.370716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b98d74cd-a9eb-4498-96da-f7b48a62bbaa-must-gather-output\") pod \"must-gather-mvwlk\" (UID: \"b98d74cd-a9eb-4498-96da-f7b48a62bbaa\") " pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.370902 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.370762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5576\" (UniqueName: \"kubernetes.io/projected/b98d74cd-a9eb-4498-96da-f7b48a62bbaa-kube-api-access-r5576\") pod \"must-gather-mvwlk\" (UID: \"b98d74cd-a9eb-4498-96da-f7b48a62bbaa\") " pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.472122 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.472036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b98d74cd-a9eb-4498-96da-f7b48a62bbaa-must-gather-output\") pod \"must-gather-mvwlk\" (UID: \"b98d74cd-a9eb-4498-96da-f7b48a62bbaa\") " pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.472122 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.472093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5576\" (UniqueName: \"kubernetes.io/projected/b98d74cd-a9eb-4498-96da-f7b48a62bbaa-kube-api-access-r5576\") pod \"must-gather-mvwlk\" (UID: \"b98d74cd-a9eb-4498-96da-f7b48a62bbaa\") " pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.472393 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.472374    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b98d74cd-a9eb-4498-96da-f7b48a62bbaa-must-gather-output\") pod \"must-gather-mvwlk\" (UID: \"b98d74cd-a9eb-4498-96da-f7b48a62bbaa\") " pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.481626 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.481602    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5576\" (UniqueName: \"kubernetes.io/projected/b98d74cd-a9eb-4498-96da-f7b48a62bbaa-kube-api-access-r5576\") pod \"must-gather-mvwlk\" (UID: \"b98d74cd-a9eb-4498-96da-f7b48a62bbaa\") " pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.516060 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.516043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sls4v/must-gather-mvwlk"
Jul 07 19:25:35.650652 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.650519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sls4v/must-gather-mvwlk"]
Jul 07 19:25:35.653265 ip-10-0-135-133 kubenswrapper[2581]: W0707 19:25:35.653222    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb98d74cd_a9eb_4498_96da_f7b48a62bbaa.slice/crio-1ae43c66ab32b2c6c2924ad5fb0e1a49c4ab8052e97133ff6d5949e62d88a2da WatchSource:0}: Error finding container 1ae43c66ab32b2c6c2924ad5fb0e1a49c4ab8052e97133ff6d5949e62d88a2da: Status 404 returned error can't find the container with id 1ae43c66ab32b2c6c2924ad5fb0e1a49c4ab8052e97133ff6d5949e62d88a2da
Jul 07 19:25:35.655166 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:35.655147    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:25:36.155661 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:36.155628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sls4v/must-gather-mvwlk" event={"ID":"b98d74cd-a9eb-4498-96da-f7b48a62bbaa","Type":"ContainerStarted","Data":"1ae43c66ab32b2c6c2924ad5fb0e1a49c4ab8052e97133ff6d5949e62d88a2da"}
Jul 07 19:25:37.161715 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:37.161681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sls4v/must-gather-mvwlk" event={"ID":"b98d74cd-a9eb-4498-96da-f7b48a62bbaa","Type":"ContainerStarted","Data":"2abbc645b10b11e81f83961a5cb4963174ff4941fe4d60ed210e2d74c1629a39"}
Jul 07 19:25:37.161715 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:37.161723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sls4v/must-gather-mvwlk" event={"ID":"b98d74cd-a9eb-4498-96da-f7b48a62bbaa","Type":"ContainerStarted","Data":"9d19f1c3ffd55cfef564f778d09176ca3711cac791fbc8f7efe0ccf050cf1d4a"}
Jul 07 19:25:37.184235 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:37.184178    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sls4v/must-gather-mvwlk" podStartSLOduration=1.228238196 podStartE2EDuration="2.184157679s" totalImagesPullingTime="955.919483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:25:37.182416849 +0000 UTC m=+2487.736308334" watchObservedRunningTime="2026-07-07 19:25:37.184157679 +0000 UTC m=+2487.738049167"
Jul 07 19:25:38.334240 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:38.334208    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8jg9g_64f1ff43-b922-41c3-9e78-59920705e8c3/global-pull-secret-syncer/0.log"
Jul 07 19:25:38.568192 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:38.568155    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tpnd4_61183db6-1671-43b3-bc1e-84cf45d04cde/konnectivity-agent/0.log"
Jul 07 19:25:38.592732 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:38.592654    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-133.ec2.internal_2d21a0c9a3a458b1cdd0669a4a363f26/haproxy/0.log"
Jul 07 19:25:43.674315 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:43.674284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lcswn_81c61bb9-b28b-4f21-9d0b-a6dc7a2bfe06/registry-server/0.log"
Jul 07 19:25:43.869564 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:43.869525    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6bzss_ef4c40d3-e6a7-430a-99f7-6c5e2d49696a/manager/0.log"
Jul 07 19:25:43.901236 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:43.901205    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tp6qp_10f7e2d0-0d3e-43c1-8645-1d59a8e66ca5/limitador/0.log"
Jul 07 19:25:46.248119 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:46.248052    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4zq2_02d22937-c23e-4a61-8477-db6e10e41ee6/node-exporter/0.log"
Jul 07 19:25:46.272146 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:46.272113    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4zq2_02d22937-c23e-4a61-8477-db6e10e41ee6/kube-rbac-proxy/0.log"
Jul 07 19:25:46.299207 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:46.299139    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4zq2_02d22937-c23e-4a61-8477-db6e10e41ee6/init-textfile/0.log"
Jul 07 19:25:48.035595 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.035558    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"]
Jul 07 19:25:48.042673 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.042638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.050544 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.050347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"]
Jul 07 19:25:48.079932 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.079883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-lib-modules\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.080120 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.079945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-proc\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.080120 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.080018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-podres\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.080120 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.080056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-sys\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.080120 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.080085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j876h\" (UniqueName: \"kubernetes.io/projected/4099049f-e931-4238-bee6-59bcc09a99f9-kube-api-access-j876h\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.181560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-lib-modules\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.181621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-proc\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.181680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-podres\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.181723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-sys\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.181755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j876h\" (UniqueName: \"kubernetes.io/projected/4099049f-e931-4238-bee6-59bcc09a99f9-kube-api-access-j876h\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.182294    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-lib-modules\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.182367    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-proc\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.182442    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-podres\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.182545 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.182491    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4099049f-e931-4238-bee6-59bcc09a99f9-sys\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.192668 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.192638    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j876h\" (UniqueName: \"kubernetes.io/projected/4099049f-e931-4238-bee6-59bcc09a99f9-kube-api-access-j876h\") pod \"perf-node-gather-daemonset-fqpq4\" (UID: \"4099049f-e931-4238-bee6-59bcc09a99f9\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.355025 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.354947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:48.550185 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:48.550137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"]
Jul 07 19:25:49.261977 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:49.261934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4" event={"ID":"4099049f-e931-4238-bee6-59bcc09a99f9","Type":"ContainerStarted","Data":"a7ad4b6a2c9d33d0a2b7323fb57e660c3e47ef9369bba9eb9872cd7a660717ed"}
Jul 07 19:25:49.262476 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:49.262003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4" event={"ID":"4099049f-e931-4238-bee6-59bcc09a99f9","Type":"ContainerStarted","Data":"c9f77566ad79eafd2846fc3d299e870d6ed5c16101364b952c08249e2cc2d0f1"}
Jul 07 19:25:49.262476 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:49.262181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:49.285601 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:49.285545    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4" podStartSLOduration=1.285525818 podStartE2EDuration="1.285525818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:25:49.283547834 +0000 UTC m=+2499.837439334" watchObservedRunningTime="2026-07-07 19:25:49.285525818 +0000 UTC m=+2499.839417304"
Jul 07 19:25:51.269695 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:51.269661    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfrdl_88b94b6a-9327-4e28-be7d-6a3f170658c6/dns/0.log"
Jul 07 19:25:51.296913 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:51.296886    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfrdl_88b94b6a-9327-4e28-be7d-6a3f170658c6/kube-rbac-proxy/0.log"
Jul 07 19:25:51.492644 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:51.492609    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlcv4_f4963235-609b-4f16-9e27-4a4bfe6ea15a/dns-node-resolver/0.log"
Jul 07 19:25:52.181151 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:52.181124    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wqprq_fed1af96-65a9-4104-aacc-e681726d1a6b/node-ca/0.log"
Jul 07 19:25:54.359367 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:54.359329    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xn8wb_85b9c528-b2ca-4546-af82-16e893694e55/serve-healthcheck-canary/0.log"
Jul 07 19:25:54.904698 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:54.904672    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ct7w_564813d0-2b2d-438a-a44e-2aacd38ac151/kube-rbac-proxy/0.log"
Jul 07 19:25:54.933944 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:54.933913    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ct7w_564813d0-2b2d-438a-a44e-2aacd38ac151/exporter/0.log"
Jul 07 19:25:54.968988 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:54.968957    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ct7w_564813d0-2b2d-438a-a44e-2aacd38ac151/extractor/0.log"
Jul 07 19:25:55.281445 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:55.281413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-fqpq4"
Jul 07 19:25:57.834752 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:57.834610    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724180-sfhjb_5e37c959-d790-4f1f-a93c-0b6081550696/cleanup/0.log"
Jul 07 19:25:57.864363 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:57.864332    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724195-m7q7l_24e256e8-ba62-4072-a220-98a5552351bd/cleanup/0.log"
Jul 07 19:25:58.198568 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:58.198480    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-jmlgg_bb86d2f3-39ed-4f03-9958-177f6946216e/manager/0.log"
Jul 07 19:25:58.221958 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:58.221933    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-jmlgg_bb86d2f3-39ed-4f03-9958-177f6946216e/copy-manifests/0.log"
Jul 07 19:25:58.305609 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:58.305581    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c8979_8c052fe2-7bca-461b-a18c-c64c26b8d58c/postgres/0.log"
Jul 07 19:25:59.754975 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:59.754941    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66b96648c9-bsckb_e7fe1941-7600-4b82-a48c-8459ba1ebda1/manager/0.log"
Jul 07 19:25:59.818739 ip-10-0-135-133 kubenswrapper[2581]: I0707 19:25:59.818713    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xlcpb_6b4aea13-5296-4b9d-809e-a86fe8c59bdb/openshift-lws-operator/0.log"