Jun 11 23:07:28.986840 ip-10-0-135-254 systemd[1]: Starting Kubernetes Kubelet... Jun 11 23:07:29.402187 ip-10-0-135-254 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:07:29.402187 ip-10-0-135-254 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 23:07:29.402187 ip-10-0-135-254 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:07:29.402187 ip-10-0-135-254 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 23:07:29.402187 ip-10-0-135-254 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:07:29.403040 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.402897 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 23:07:29.409092 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409074 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:29.409092 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409089 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:29.409092 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409094 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:29.409092 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409097 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409101 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409104 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409106 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409109 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409112 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409114 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409117 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409125 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409127 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409130 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409133 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409135 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409138 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409140 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409143 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409145 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409148 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409150 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:29.409236 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409153 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409156 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409158 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409161 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409164 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409167 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409169 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409172 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409174 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409177 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409179 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409181 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409184 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409186 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409189 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409192 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409195 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409197 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409201 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409204 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:29.409715 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409206 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409210 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409214 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409219 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409223 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409226 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409229 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409232 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409235 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409238 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409241 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409244 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409247 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409249 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409252 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409255 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409257 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409260 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409262 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:29.410366 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409265 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409267 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409270 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409272 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409275 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409277 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409280 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409283 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409287 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409290 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409299 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409302 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409305 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409307 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409310 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409312 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409315 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409318 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409321 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409323 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409326 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:29.410835 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409328 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409331 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409333 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409335 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409338 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409340 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409343 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409347 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409349 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409352 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409355 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409357 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409361 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409365 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409368 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409370 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:29.411440 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.409373 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411827 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411834 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411838 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411840 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411843 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411846 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411849 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411851 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411854 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411856 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411859 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411863 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411867 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411870 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411873 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411876 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411879 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411882 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:29.411912 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411884 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411887 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411889 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411892 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411895 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411898 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411902 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411904 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411907 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411909 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411911 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411914 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411917 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411920 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411922 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411925 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411928 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411930 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411933 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411936 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:29.412398 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411939 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411941 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411944 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411946 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411949 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411952 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411954 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411957 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411959 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411962 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411964 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411966 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411969 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411972 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411976 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411978 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411981 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411983 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411986 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411989 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:29.412989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411991 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411994 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411997 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.411999 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412002 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412004 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412007 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412009 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412013 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412016 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412018 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412021 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412023 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412027 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412029 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412032 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412034 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412037 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412039 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412042 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:29.413493 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412044 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412047 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412049 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412052 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412054 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412057 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412060 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412063 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412065 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412068 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412070 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412073 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412075 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412078 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412080 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412082 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412085 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412087 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412089 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412092 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:29.413989 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412094 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412493 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412499 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412502 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412505 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412508 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412511 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412514 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412516 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412519 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412521 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412524 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412526 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412529 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412532 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412535 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412538 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412540 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412544 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:29.414532 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412547 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412549 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412552 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412555 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412557 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412560 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412562 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412565 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412568 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412570 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412572 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412576 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412580 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412582 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412585 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412587 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412590 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412592 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412595 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412598 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:29.415012 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412601 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412604 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412607 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412610 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412612 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412615 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412618 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412620 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412623 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412625 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412628 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412630 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412633 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412635 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412638 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412641 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412643 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412646 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412648 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412650 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:29.415609 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412653 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412655 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412657 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412660 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412662 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412665 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412667 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412669 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412672 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412674 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412677 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412679 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412682 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412685 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412687 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412690 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412693 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412696 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412698 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412701 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:29.416123 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412704 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412706 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412709 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412712 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412714 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412719 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412722 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412725 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412728 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412731 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412733 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412736 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412739 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412741 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412744 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412746 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412750 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412753 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412756 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:29.416627 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412759 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.412761 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412829 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412835 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412841 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412848 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412856 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412861 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412867 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412873 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412877 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412880 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412883 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412886 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412889 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412892 2581 flags.go:64] FLAG: --cgroup-root="" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412895 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412898 2581 flags.go:64] FLAG: --client-ca-file="" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412901 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412904 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412908 2581 flags.go:64] FLAG: --cluster-domain="" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412910 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412913 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412916 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 23:07:29.417103 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412919 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412923 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412926 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412941 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412946 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412949 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412952 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412955 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412958 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412961 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412965 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412968 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412971 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412973 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412976 2581 flags.go:64] FLAG: --enable-server="true" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412980 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412985 2581 flags.go:64] FLAG: --event-burst="100" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412988 2581 flags.go:64] FLAG: --event-qps="50" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412991 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412994 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.412997 2581 flags.go:64] FLAG: --eviction-hard="" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413001 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413003 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413006 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413010 2581 flags.go:64] FLAG: --eviction-soft="" Jun 11 23:07:29.417747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413013 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413015 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413018 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413021 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413024 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413027 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413030 2581 flags.go:64] FLAG: --feature-gates="" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413033 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413036 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413039 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413042 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413045 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413048 2581 flags.go:64] FLAG: --help="false" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413051 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413054 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413057 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413059 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413063 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413066 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413069 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413072 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413077 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413080 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 23:07:29.418338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413084 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413087 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413090 2581 flags.go:64] FLAG: --kube-reserved="" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413092 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413095 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413098 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413101 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413103 2581 flags.go:64] FLAG: --lock-file="" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413110 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413112 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413115 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413120 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413123 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413126 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413129 2581 flags.go:64] FLAG: --logging-format="text" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413132 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413135 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413138 2581 flags.go:64] FLAG: --manifest-url="" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413140 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413144 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413147 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413151 2581 flags.go:64] FLAG: --max-pods="110" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413154 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413157 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413159 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 23:07:29.419022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413162 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413165 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413168 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413170 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413177 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413181 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413184 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413187 2581 flags.go:64] FLAG: --pod-cidr="" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413190 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413196 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413198 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413201 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413204 2581 flags.go:64] FLAG: --port="10250" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413207 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413210 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ef1a39bbb2d02a3" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413213 2581 flags.go:64] FLAG: --qos-reserved="" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413217 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413221 2581 flags.go:64] FLAG: --register-node="true" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413223 2581 flags.go:64] FLAG: --register-with-taints="" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413227 2581 flags.go:64] FLAG: --registry-burst="10" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413230 2581 flags.go:64] FLAG: --registry-qps="5" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413232 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413235 2581 flags.go:64] FLAG: --reserved-memory="" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413238 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413241 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 23:07:29.419745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413244 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413247 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413249 2581 flags.go:64] FLAG: --runonce="false" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413252 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413255 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413258 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413261 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413264 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413266 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413269 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413272 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413275 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413283 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413285 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413288 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413291 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413295 2581 flags.go:64] FLAG: --system-cgroups="" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413297 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413303 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413305 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413308 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413312 2581 flags.go:64] FLAG: --tls-min-version="" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413314 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413319 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413322 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 23:07:29.420375 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413324 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413327 2581 flags.go:64] FLAG: --v="2" Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413331 2581 flags.go:64] FLAG: --version="false" Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413335 2581 flags.go:64] FLAG: --vmodule="" Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413338 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.413341 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413467 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413471 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413474 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413478 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413480 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413483 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413486 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413488 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413492 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413495 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413499 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413502 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413504 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413509 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:29.421005 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413511 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413514 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413517 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413519 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413522 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413525 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413528 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413530 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413533 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413535 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413539 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413542 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413545 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413547 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413550 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413552 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413555 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413558 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413560 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413563 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:29.421536 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413565 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413568 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413571 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413573 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413576 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413578 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413581 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413583 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413586 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413588 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413591 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413595 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413597 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413600 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413603 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413605 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413607 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413610 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413613 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413615 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:29.422032 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413618 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413622 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413626 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413629 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413632 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413634 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413637 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413639 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413642 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413645 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413647 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413650 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413652 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413654 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413657 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413660 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413662 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413665 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413667 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413670 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:29.422704 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413673 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413675 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413677 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413681 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413684 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413686 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413689 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413692 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413694 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413697 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413700 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413702 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413705 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413707 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413711 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413714 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413716 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413720 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413723 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:29.423193 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413726 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413729 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413731 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413734 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413736 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.413739 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.414493 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.421394 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.421414 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.421428 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.421434 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421510 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421516 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421519 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:29.423679 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421522 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421524 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421527 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421530 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421532 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421535 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421537 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421540 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421543 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421545 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421548 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421550 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421553 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421555 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421558 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421561 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421563 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421566 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421568 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421571 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:29.424024 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421573 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421576 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421579 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421581 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421583 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421586 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421595 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421598 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421600 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421603 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421606 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421609 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421611 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421614 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421617 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421619 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421622 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421624 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421626 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421629 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:29.424521 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421631 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421634 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421636 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421639 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421641 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421644 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421646 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421648 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421651 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421655 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421659 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421661 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421664 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421666 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421669 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421671 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421674 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421676 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421680 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:29.425013 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421688 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421690 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421693 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421695 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421698 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421702 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421705 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421708 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421711 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421714 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421716 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421719 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421721 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421724 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421726 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421729 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421731 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421734 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421736 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421739 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:29.425464 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421741 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421744 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421746 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421748 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421751 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421753 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421756 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421758 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421761 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421763 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421766 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421769 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421772 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421779 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421783 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421786 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:29.425953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421789 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.421794 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421944 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421949 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421952 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421954 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421957 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421960 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421962 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421965 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421967 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421970 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421972 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421975 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421977 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:29.426347 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421979 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421982 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421984 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421987 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421989 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421992 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421994 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421997 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.421999 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422001 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422004 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422006 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422009 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422012 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422014 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422022 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422025 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422027 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422030 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422032 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:29.426867 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422035 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422038 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422040 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422043 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422045 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422048 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422050 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422053 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422055 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422058 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422060 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422062 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422064 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422067 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422069 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422073 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422076 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422079 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422082 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422085 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:29.427491 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422088 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422090 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422094 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422097 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422100 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422103 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422105 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422108 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422116 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422119 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422121 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422124 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422126 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422128 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422131 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422133 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422136 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422138 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422140 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:29.428137 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422143 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422145 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422148 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422150 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422153 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422155 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422158 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422160 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422163 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422165 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422168 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422170 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422173 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422175 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422177 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422180 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422182 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422185 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422187 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422189 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:29.428935 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422192 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422195 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422202 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422205 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422208 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422211 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:29.422214 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.422219 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.422359 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.424508 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.426015 2581 server.go:1019] "Starting client certificate rotation" Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.426128 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:07:29.429778 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.426161 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:07:29.430664 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.430648 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:07:29.431889 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.431873 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:07:29.441067 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.441050 2581 log.go:25] "Validated CRI v1 runtime API" Jun 11 23:07:29.446178 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.446160 2581 log.go:25] "Validated CRI v1 image API" Jun 11 23:07:29.446953 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.446936 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 23:07:29.450228 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.450207 2581 fs.go:135] Filesystem UUIDs: map[3b57f96c-26eb-49b4-8bde-561b02f896ce:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7b6a30a1-dcb3-45f1-9ddd-c34884d590bc:/dev/nvme0n1p4] Jun 11 23:07:29.450386 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.450227 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 23:07:29.457233 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.457118 2581 manager.go:216] Machine: {Timestamp:2026-06-11 23:07:29.455813099 +0000 UTC m=+0.352279154 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103007 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d378a80607113bbb8b1c665beec74 SystemUUID:ec2d378a-8060-7113-bbb8-b1c665beec74 BootID:8ac22bf9-11ed-4fcf-8e10-91223d1a5e7d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:a8:b0:53:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:a8:b0:53:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:e7:03:86:5d:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 23:07:29.457233 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.457222 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 23:07:29.457391 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.457322 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 23:07:29.460279 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.460246 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 23:07:29.460366 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.460329 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:07:29.460513 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.460282 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-254.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 23:07:29.461182 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.461168 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 23:07:29.461252 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.461187 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 23:07:29.461252 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.461198 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:07:29.461918 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.461905 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:07:29.463248 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.463226 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 23:07:29.466232 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466217 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:07:29.466366 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466354 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 23:07:29.466433 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466424 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 11 23:07:29.466502 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466443 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 23:07:29.466502 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466482 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 23:07:29.466502 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466495 2581 kubelet.go:398] "Adding apiserver pod source" Jun 11 23:07:29.466626 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466509 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 23:07:29.466884 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466870 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:07:29.466946 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.466892 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:07:29.469413 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.469387 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 23:07:29.471467 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471437 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 23:07:29.471530 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471491 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 23:07:29.471682 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471669 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 23:07:29.471715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471693 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 23:07:29.471715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471703 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 23:07:29.471715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471713 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 23:07:29.471789 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471724 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 23:07:29.471789 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.471732 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 23:07:29.472236 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.472225 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 23:07:29.472265 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.472239 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 23:07:29.472265 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.472249 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 23:07:29.472265 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.472258 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 23:07:29.475443 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.475430 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 23:07:29.475506 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.475462 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 23:07:29.476306 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.476290 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vpqr2" Jun 11 23:07:29.476781 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.476766 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 23:07:29.476830 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.476785 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 23:07:29.479980 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.479966 2581 server.go:1268] "Started kubelet" Jun 11 23:07:29.484764 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.484086 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 23:07:29.484764 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.484111 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 23:07:29.484764 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.484180 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 23:07:29.485260 ip-10-0-135-254 systemd[1]: Started Kubernetes Kubelet. Jun 11 23:07:29.485510 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.485294 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-254.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 23:07:29.485610 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.485580 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 23:07:29.486398 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.485978 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 23:07:29.486398 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.486071 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 23:07:29.486398 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.486354 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vpqr2" Jun 11 23:07:29.488217 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.488200 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 11 23:07:29.491857 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.491047 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-254.ec2.internal.18b829785856eb3e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-254.ec2.internal,UID:ip-10-0-135-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-254.ec2.internal,},FirstTimestamp:2026-06-11 23:07:29.47993683 +0000 UTC m=+0.376402884,LastTimestamp:2026-06-11 23:07:29.47993683 +0000 UTC m=+0.376402884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-254.ec2.internal,}" Jun 11 23:07:29.493117 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.493096 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 23:07:29.494414 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.494393 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 23:07:29.494414 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.494401 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 23:07:29.494562 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.494512 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:29.495441 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495062 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 23:07:29.495577 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495558 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 23:07:29.495577 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495579 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 23:07:29.495715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495706 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 11 23:07:29.495715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495713 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 11 23:07:29.495989 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495972 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 23:07:29.495989 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495990 2581 factory.go:55] Registering systemd factory Jun 11 23:07:29.496138 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.495997 2581 factory.go:223] Registration of the systemd container factory successfully Jun 11 23:07:29.496190 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.496181 2581 factory.go:153] Registering CRI-O factory Jun 11 23:07:29.496238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.496192 2581 factory.go:223] Registration of the crio container factory successfully Jun 11 23:07:29.496238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.496216 2581 factory.go:103] Registering Raw factory Jun 11 23:07:29.496238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.496229 2581 manager.go:1196] Started watching for new ooms in manager Jun 11 23:07:29.496719 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.496703 2581 manager.go:349] Starting recovery of all containers Jun 11 23:07:29.499629 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.499608 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:29.502228 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.502202 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-254.ec2.internal\" not found" node="ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.506984 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.506969 2581 manager.go:354] Recovery completed Jun 11 23:07:29.512310 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.512295 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:29.517081 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.517060 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:29.517165 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.517092 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:29.517165 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.517103 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:29.517606 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.517593 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 23:07:29.517667 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.517604 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:29.517667 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.517604 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 23:07:29.517667 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.517664 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:07:29.519129 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.519112 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:29.519188 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.519169 2581 policy_none.go:49] "None policy: Start" Jun 11 23:07:29.519220 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.519159 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:29.519287 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.519192 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 23:07:29.519319 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.519292 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 23:07:29.519347 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.519308 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:29.520313 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.520303 2581 policy_none.go:47] "Start" Jun 11 23:07:29.563619 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.563585 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 23:07:29.565292 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.564900 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 23:07:29.565292 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.564936 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 23:07:29.565292 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.564957 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 23:07:29.565292 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.565038 2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 11 23:07:29.567424 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.567405 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:29.568153 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.568137 2581 manager.go:337] "Starting Device Plugin manager" Jun 11 23:07:29.568244 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.568168 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 23:07:29.568244 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.568181 2581 server.go:87] "Starting device plugin registration server" Jun 11 23:07:29.568460 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.568434 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 23:07:29.568513 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.568465 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 23:07:29.568591 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.568576 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 23:07:29.568671 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.568661 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 23:07:29.568739 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.568672 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 23:07:29.569097 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.569076 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 23:07:29.569176 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.569130 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:29.666168 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.666061 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"] Jun 11 23:07:29.666168 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.666157 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:29.668517 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.668498 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:29.668615 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.668527 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:29.668615 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.668528 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:29.668719 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.668622 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:29.669324 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.669308 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:29.669385 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.669335 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:29.669385 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.669347 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:29.669385 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.669373 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.669880 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.669868 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:29.669983 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.669971 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.670016 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.669997 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:29.670878 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.670860 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:29.670953 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.670889 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:29.670953 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.670902 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:29.670953 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.670919 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:29.670953 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.670934 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:29.671132 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.670904 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:29.672236 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.672219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.672321 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.672248 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:29.676948 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.676930 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.677035 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.676953 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-254.ec2.internal\": node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:29.678557 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.678540 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:29.678630 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.678572 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:29.678630 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.678582 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:29.688038 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.688017 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-254.ec2.internal\" not found" node="ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.693836 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.693818 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-254.ec2.internal\" not found" node="ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.693931 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.693912 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:29.795000 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.794972 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:29.796118 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.796102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39a67b469fc72ec0b31210c0d3168786-config\") pod \"kube-apiserver-proxy-ip-10-0-135-254.ec2.internal\" (UID: \"39a67b469fc72ec0b31210c0d3168786\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.796171 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.796125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/679142bdec860e0cfe96636537cb79b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"679142bdec860e0cfe96636537cb79b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.796171 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.796145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/679142bdec860e0cfe96636537cb79b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"679142bdec860e0cfe96636537cb79b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.896061 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.896032 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:29.897188 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.897169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39a67b469fc72ec0b31210c0d3168786-config\") pod \"kube-apiserver-proxy-ip-10-0-135-254.ec2.internal\" (UID: \"39a67b469fc72ec0b31210c0d3168786\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.897238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.897196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/679142bdec860e0cfe96636537cb79b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"679142bdec860e0cfe96636537cb79b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.897238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.897216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/679142bdec860e0cfe96636537cb79b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"679142bdec860e0cfe96636537cb79b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.897302 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.897273 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/679142bdec860e0cfe96636537cb79b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"679142bdec860e0cfe96636537cb79b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.897302 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.897275 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39a67b469fc72ec0b31210c0d3168786-config\") pod \"kube-apiserver-proxy-ip-10-0-135-254.ec2.internal\" (UID: \"39a67b469fc72ec0b31210c0d3168786\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.897302 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.897286 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/679142bdec860e0cfe96636537cb79b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"679142bdec860e0cfe96636537cb79b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.990728 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.990646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:29.997024 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:29.997001 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:29.997125 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:29.997027 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" Jun 11 23:07:30.097707 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:30.097665 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:30.198171 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:30.198143 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:30.298710 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:30.298631 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:30.399287 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:30.399119 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:30.425377 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.425348 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 23:07:30.425978 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.425545 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:07:30.425978 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.425546 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:07:30.491827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.491774 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 23:02:29 +0000 UTC" deadline="2028-02-20 06:07:34.615630218 +0000 UTC" Jun 11 23:07:30.491914 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.491828 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14839h0m4.123807896s" Jun 11 23:07:30.499572 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:30.499547 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:30.499955 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:30.499927 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679142bdec860e0cfe96636537cb79b1.slice/crio-a745929abf6e544f4fee34c5d92bf341fe5bbad99f1c487e6cd7fac733da69ff WatchSource:0}: Error finding container a745929abf6e544f4fee34c5d92bf341fe5bbad99f1c487e6cd7fac733da69ff: Status 404 returned error can't find the container with id a745929abf6e544f4fee34c5d92bf341fe5bbad99f1c487e6cd7fac733da69ff Jun 11 23:07:30.500742 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:30.500722 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a67b469fc72ec0b31210c0d3168786.slice/crio-f5908ce64906d2483d7cc5956d8f56dd1e70238c8d42e71133bf5745e1d591f6 WatchSource:0}: Error finding container f5908ce64906d2483d7cc5956d8f56dd1e70238c8d42e71133bf5745e1d591f6: Status 404 returned error can't find the container with id f5908ce64906d2483d7cc5956d8f56dd1e70238c8d42e71133bf5745e1d591f6 Jun 11 23:07:30.506339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.506326 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:07:30.568427 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.568307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" event={"ID":"679142bdec860e0cfe96636537cb79b1","Type":"ContainerStarted","Data":"a745929abf6e544f4fee34c5d92bf341fe5bbad99f1c487e6cd7fac733da69ff"} Jun 11 23:07:30.569276 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.569256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" event={"ID":"39a67b469fc72ec0b31210c0d3168786","Type":"ContainerStarted","Data":"f5908ce64906d2483d7cc5956d8f56dd1e70238c8d42e71133bf5745e1d591f6"} Jun 11 23:07:30.600571 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:30.600553 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found" Jun 11 23:07:30.630088 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.630070 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:30.695118 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.695095 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" Jun 11 23:07:30.715664 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.715644 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:07:30.717444 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.717432 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" Jun 11 23:07:30.737938 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.737922 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:07:30.753811 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:30.753787 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:31.467769 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.467734 2581 apiserver.go:52] "Watching apiserver" Jun 11 23:07:31.474345 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.474317 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 23:07:31.474765 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.474740 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-jcgbd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8","openshift-dns/node-resolver-5lf6p","openshift-multus/multus-additional-cni-plugins-wvwj8","openshift-multus/multus-fpc67","openshift-ovn-kubernetes/ovnkube-node-lfgz7","kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal","openshift-cluster-node-tuning-operator/tuned-xjwxl","openshift-image-registry/node-ca-znj4l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal","openshift-multus/network-metrics-daemon-ggh42","openshift-network-diagnostics/network-check-target-jmw2c","openshift-network-operator/iptables-alerter-7lhr9","kube-system/global-pull-secret-syncer-v54pq"] Jun 11 23:07:31.476390 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.476360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.477726 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.477699 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.478964 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.478946 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 23:07:31.479221 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.479198 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:07:31.479407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.479391 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 23:07:31.479486 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.479442 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k62w2\"" Jun 11 23:07:31.479955 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.479935 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.480042 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.479980 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 23:07:31.480042 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.479983 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 23:07:31.480160 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.480046 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p2bmq\"" Jun 11 23:07:31.480315 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.480299 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 23:07:31.482433 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.481384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.482433 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.482022 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 23:07:31.482433 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.482219 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hgf29\"" Jun 11 23:07:31.482433 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.482219 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 23:07:31.483049 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.483029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.483865 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.483620 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 23:07:31.483865 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.483664 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 23:07:31.483865 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.483620 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bd7r4\"" Jun 11 23:07:31.484348 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.484168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 23:07:31.484519 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.484499 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 23:07:31.484701 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.484686 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 23:07:31.485320 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.485303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.487559 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.487538 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.488563 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488035 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 23:07:31.488563 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488260 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 23:07:31.488563 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488288 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dqtnk\"" Jun 11 23:07:31.488563 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488310 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 23:07:31.488563 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488523 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 23:07:31.488844 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488619 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vbqxc\"" Jun 11 23:07:31.488844 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488743 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 23:07:31.488946 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488919 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 23:07:31.488993 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.488948 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 23:07:31.490966 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.490569 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 23:07:31.490966 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.490654 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 23:07:31.490966 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.490658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.490966 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.490783 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jvx8b\"" Jun 11 23:07:31.492283 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.492268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.493047 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.493030 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mwwtc\"" Jun 11 23:07:31.493191 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.493168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:07:31.493513 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.493496 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 23:07:31.493676 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.493662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.493763 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.493739 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:31.495235 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.495214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:31.495335 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.495296 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:31.495396 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.495375 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2ktjn\"" Jun 11 23:07:31.495476 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.495395 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 23:07:31.496016 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.495750 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 23:07:31.496016 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.495807 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 23:07:31.496016 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.495896 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:31.496201 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.496053 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 23:07:31.497796 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.497773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:31.497873 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.497827 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:31.505398 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:31.505519 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-netns\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.505519 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-kubelet\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.505519 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505485 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-env-overrides\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.505519 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysctl-conf\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.505697 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-device-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.505697 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-kubernetes\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.505697 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-var-lib-kubelet\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.505697 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lzjw\" (UniqueName: \"kubernetes.io/projected/090f26b9-5ce0-4dee-875f-9b50918297f1-kube-api-access-8lzjw\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.505697 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-system-cni-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.505697 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-cni-netd\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e236869f-8f00-433a-af4d-025a7112d99d-ovn-node-metrics-cert\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-sys\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-cni-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-modprobe-d\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3803699b-9579-4159-9374-ed639ed00c35-agent-certs\") pod \"konnectivity-agent-jcgbd\" (UID: \"3803699b-9579-4159-9374-ed639ed00c35\") " pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:31.505935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3d22ad7-718d-41af-9afb-5d5432ddc04a-iptables-alerter-script\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.505991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sffph\" (UniqueName: \"kubernetes.io/projected/69030a61-4820-4cbc-b2af-24cf40f5a6a5-kube-api-access-sffph\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-os-release\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-host\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-ovn\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-multus-certs\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-systemd-units\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-run-netns\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-systemd\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-ovnkube-config\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysconfig\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3d22ad7-718d-41af-9afb-5d5432ddc04a-host-slash\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.506318 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-os-release\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3803699b-9579-4159-9374-ed639ed00c35-konnectivity-ca\") pod \"konnectivity-agent-jcgbd\" (UID: \"3803699b-9579-4159-9374-ed639ed00c35\") " pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21c80d7a-b6b4-4596-a631-ca2d9023a695-kubelet-config\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-k8s-cni-cncf-io\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-node-log\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-lib-modules\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21c80d7a-b6b4-4596-a631-ca2d9023a695-dbus\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-conf-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-etc-kubernetes\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506631 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-etc-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysctl-d\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/090f26b9-5ce0-4dee-875f-9b50918297f1-tmp\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506717 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eac0f764-298c-48eb-822e-f46def43a74a-serviceca\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-registration-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88x8h\" (UniqueName: \"kubernetes.io/projected/eac0f764-298c-48eb-822e-f46def43a74a-kube-api-access-88x8h\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.507054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpwz4\" (UniqueName: \"kubernetes.io/projected/e3d22ad7-718d-41af-9afb-5d5432ddc04a-kube-api-access-jpwz4\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cnibin\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.506990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-kubelet\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgmp\" (UniqueName: \"kubernetes.io/projected/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-kube-api-access-6vgmp\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-log-socket\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxhvr\" (UniqueName: \"kubernetes.io/projected/e236869f-8f00-433a-af4d-025a7112d99d-kube-api-access-vxhvr\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eac0f764-298c-48eb-822e-f46def43a74a-host\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-cni-binary-copy\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-cni-bin\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-daemon-config\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-systemd\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qswf\" (UniqueName: \"kubernetes.io/projected/4d75fb5c-1713-4cfd-94bd-9fb67342173a-kube-api-access-6qswf\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-socket-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7lcz\" (UniqueName: \"kubernetes.io/projected/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-kube-api-access-d7lcz\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:31.507827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-socket-dir-parent\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-hostroot\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-cni-bin\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnj8\" (UniqueName: \"kubernetes.io/projected/9610ba9d-2fd0-409f-9002-4f23144dd4aa-kube-api-access-8jnj8\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-system-cni-dir\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-slash\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-var-lib-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-ovnkube-script-lib\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-run\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-tuned\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d75fb5c-1713-4cfd-94bd-9fb67342173a-hosts-file\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-sys-fs\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-cnibin\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-cni-multus\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.507789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d75fb5c-1713-4cfd-94bd-9fb67342173a-tmp-dir\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.508662 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.508064 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:07:31.532613 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.532592 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2pg25" Jun 11 23:07:31.540867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.540845 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2pg25" Jun 11 23:07:31.596399 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.596368 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 23:07:31.608205 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:31.608205 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-netns\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-kubelet\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-env-overrides\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysctl-conf\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-device-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-kubernetes\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-kubelet\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-var-lib-kubelet\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.608336 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lzjw\" (UniqueName: \"kubernetes.io/projected/090f26b9-5ce0-4dee-875f-9b50918297f1-kube-api-access-8lzjw\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-system-cni-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.608428 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:32.108403728 +0000 UTC m=+3.004869790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:31.608469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-system-cni-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-cni-netd\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608491 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysctl-conf\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e236869f-8f00-433a-af4d-025a7112d99d-ovn-node-metrics-cert\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-kubernetes\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-sys\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608571 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-cni-netd\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-cni-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-sys\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-modprobe-d\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608575 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-var-lib-kubelet\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608530 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-device-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608678 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608697 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-cni-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3803699b-9579-4159-9374-ed639ed00c35-agent-certs\") pod \"konnectivity-agent-jcgbd\" (UID: \"3803699b-9579-4159-9374-ed639ed00c35\") " pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.608867 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608764 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-modprobe-d\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3d22ad7-718d-41af-9afb-5d5432ddc04a-iptables-alerter-script\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.608782 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.608830 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret podName:21c80d7a-b6b4-4596-a631-ca2d9023a695 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:32.108813604 +0000 UTC m=+3.005279660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret") pod "global-pull-secret-syncer-v54pq" (UID: "21c80d7a-b6b4-4596-a631-ca2d9023a695") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608867 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-env-overrides\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sffph\" (UniqueName: \"kubernetes.io/projected/69030a61-4820-4cbc-b2af-24cf40f5a6a5-kube-api-access-sffph\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-os-release\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-host\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-ovn\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-multus-certs\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.608995 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-systemd-units\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.609339 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609019 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-run-netns\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-host\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-systemd\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-ovnkube-config\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609089 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-ovn\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysconfig\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609125 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609146 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-systemd-units\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-multus-certs\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3d22ad7-718d-41af-9afb-5d5432ddc04a-host-slash\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609190 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-systemd\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-run-netns\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609233 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysconfig\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609298 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-os-release\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609299 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3d22ad7-718d-41af-9afb-5d5432ddc04a-iptables-alerter-script\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.610045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609304 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3d22ad7-718d-41af-9afb-5d5432ddc04a-host-slash\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609312 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-netns\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-os-release\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3803699b-9579-4159-9374-ed639ed00c35-konnectivity-ca\") pod \"konnectivity-agent-jcgbd\" (UID: \"3803699b-9579-4159-9374-ed639ed00c35\") " pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21c80d7a-b6b4-4596-a631-ca2d9023a695-kubelet-config\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-k8s-cni-cncf-io\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609465 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-os-release\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-node-log\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609535 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-node-log\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609540 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-lib-modules\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21c80d7a-b6b4-4596-a631-ca2d9023a695-dbus\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21c80d7a-b6b4-4596-a631-ca2d9023a695-kubelet-config\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-conf-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-etc-kubernetes\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609626 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-run-k8s-cni-cncf-io\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.610817 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-etc-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysctl-d\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21c80d7a-b6b4-4596-a631-ca2d9023a695-dbus\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/090f26b9-5ce0-4dee-875f-9b50918297f1-tmp\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eac0f764-298c-48eb-822e-f46def43a74a-serviceca\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-etc-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-registration-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88x8h\" (UniqueName: \"kubernetes.io/projected/eac0f764-298c-48eb-822e-f46def43a74a-kube-api-access-88x8h\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-conf-dir\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-lib-modules\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpwz4\" (UniqueName: \"kubernetes.io/projected/e3d22ad7-718d-41af-9afb-5d5432ddc04a-kube-api-access-jpwz4\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609668 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-ovnkube-config\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cnibin\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-etc-kubernetes\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609895 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-sysctl-d\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-registration-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-kubelet\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.611815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.609985 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-kubelet\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3803699b-9579-4159-9374-ed639ed00c35-konnectivity-ca\") pod \"konnectivity-agent-jcgbd\" (UID: \"3803699b-9579-4159-9374-ed639ed00c35\") " pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgmp\" (UniqueName: \"kubernetes.io/projected/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-kube-api-access-6vgmp\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-log-socket\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610177 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-log-socket\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610193 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cnibin\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610222 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-run-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxhvr\" (UniqueName: \"kubernetes.io/projected/e236869f-8f00-433a-af4d-025a7112d99d-kube-api-access-vxhvr\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eac0f764-298c-48eb-822e-f46def43a74a-host\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610320 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eac0f764-298c-48eb-822e-f46def43a74a-serviceca\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-cni-binary-copy\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-cni-bin\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-daemon-config\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eac0f764-298c-48eb-822e-f46def43a74a-host\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-systemd\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qswf\" (UniqueName: \"kubernetes.io/projected/4d75fb5c-1713-4cfd-94bd-9fb67342173a-kube-api-access-6qswf\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.612665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-socket-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7lcz\" (UniqueName: \"kubernetes.io/projected/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-kube-api-access-d7lcz\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610610 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-cni-bin\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-socket-dir-parent\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-hostroot\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-cni-bin\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnj8\" (UniqueName: \"kubernetes.io/projected/9610ba9d-2fd0-409f-9002-4f23144dd4aa-kube-api-access-8jnj8\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-system-cni-dir\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-slash\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-var-lib-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-ovnkube-script-lib\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-run\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-tuned\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d75fb5c-1713-4cfd-94bd-9fb67342173a-hosts-file\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-sys-fs\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-cnibin\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.613610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-cni-multus\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.610982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d75fb5c-1713-4cfd-94bd-9fb67342173a-tmp-dir\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611066 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611097 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-daemon-config\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-cni-binary-copy\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-slash\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611174 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-systemd\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611217 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-hostroot\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d75fb5c-1713-4cfd-94bd-9fb67342173a-tmp-dir\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611368 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-host-cni-bin\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611382 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d75fb5c-1713-4cfd-94bd-9fb67342173a-hosts-file\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69030a61-4820-4cbc-b2af-24cf40f5a6a5-system-cni-dir\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611621 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-multus-socket-dir-parent\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/090f26b9-5ce0-4dee-875f-9b50918297f1-run\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611706 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-sys-fs\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-cnibin\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-host-var-lib-cni-multus\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611789 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e236869f-8f00-433a-af4d-025a7112d99d-var-lib-openvswitch\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.614273 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611894 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9610ba9d-2fd0-409f-9002-4f23144dd4aa-socket-dir\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.614935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69030a61-4820-4cbc-b2af-24cf40f5a6a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.614935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.611963 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e236869f-8f00-433a-af4d-025a7112d99d-ovnkube-script-lib\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.614935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.613274 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3803699b-9579-4159-9374-ed639ed00c35-agent-certs\") pod \"konnectivity-agent-jcgbd\" (UID: \"3803699b-9579-4159-9374-ed639ed00c35\") " pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.614935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.613733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/090f26b9-5ce0-4dee-875f-9b50918297f1-etc-tuned\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.614935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.614041 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/090f26b9-5ce0-4dee-875f-9b50918297f1-tmp\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.614935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.614045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e236869f-8f00-433a-af4d-025a7112d99d-ovn-node-metrics-cert\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.615659 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.615631 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:31.617759 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.617711 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:31.617759 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.617736 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:31.617759 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.617751 2581 projected.go:196] Error preparing data for projected volume kube-api-access-8czpw for pod openshift-network-diagnostics/network-check-target-jmw2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:31.617969 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:31.617812 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw podName:71cff971-145d-499a-9807-a51e8eadda63 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:32.117796761 +0000 UTC m=+3.014262803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8czpw" (UniqueName: "kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw") pod "network-check-target-jmw2c" (UID: "71cff971-145d-499a-9807-a51e8eadda63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:31.620884 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.620791 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88x8h\" (UniqueName: \"kubernetes.io/projected/eac0f764-298c-48eb-822e-f46def43a74a-kube-api-access-88x8h\") pod \"node-ca-znj4l\" (UID: \"eac0f764-298c-48eb-822e-f46def43a74a\") " pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:31.621268 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.621247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lzjw\" (UniqueName: \"kubernetes.io/projected/090f26b9-5ce0-4dee-875f-9b50918297f1-kube-api-access-8lzjw\") pod \"tuned-xjwxl\" (UID: \"090f26b9-5ce0-4dee-875f-9b50918297f1\") " pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.621268 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.621263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgmp\" (UniqueName: \"kubernetes.io/projected/5dcf1664-9e8a-4555-a787-6b709f4e8cd0-kube-api-access-6vgmp\") pod \"multus-fpc67\" (UID: \"5dcf1664-9e8a-4555-a787-6b709f4e8cd0\") " pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.621968 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.621946 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpwz4\" (UniqueName: \"kubernetes.io/projected/e3d22ad7-718d-41af-9afb-5d5432ddc04a-kube-api-access-jpwz4\") pod \"iptables-alerter-7lhr9\" (UID: \"e3d22ad7-718d-41af-9afb-5d5432ddc04a\") " pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.622183 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.622166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sffph\" (UniqueName: \"kubernetes.io/projected/69030a61-4820-4cbc-b2af-24cf40f5a6a5-kube-api-access-sffph\") pod \"multus-additional-cni-plugins-wvwj8\" (UID: \"69030a61-4820-4cbc-b2af-24cf40f5a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.624459 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.624418 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qswf\" (UniqueName: \"kubernetes.io/projected/4d75fb5c-1713-4cfd-94bd-9fb67342173a-kube-api-access-6qswf\") pod \"node-resolver-5lf6p\" (UID: \"4d75fb5c-1713-4cfd-94bd-9fb67342173a\") " pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.624941 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.624918 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7lcz\" (UniqueName: \"kubernetes.io/projected/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-kube-api-access-d7lcz\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:31.625232 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.625215 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxhvr\" (UniqueName: \"kubernetes.io/projected/e236869f-8f00-433a-af4d-025a7112d99d-kube-api-access-vxhvr\") pod \"ovnkube-node-lfgz7\" (UID: \"e236869f-8f00-433a-af4d-025a7112d99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.625307 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.625258 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnj8\" (UniqueName: \"kubernetes.io/projected/9610ba9d-2fd0-409f-9002-4f23144dd4aa-kube-api-access-8jnj8\") pod \"aws-ebs-csi-driver-node-pllh8\" (UID: \"9610ba9d-2fd0-409f-9002-4f23144dd4aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.788674 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.788579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7lhr9" Jun 11 23:07:31.796727 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.796703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" Jun 11 23:07:31.806093 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.806071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5lf6p" Jun 11 23:07:31.811970 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.811944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" Jun 11 23:07:31.820761 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.820733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fpc67" Jun 11 23:07:31.827001 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.826978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:31.834891 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.834867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:31.840874 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.840854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" Jun 11 23:07:31.846941 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:31.846922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-znj4l" Jun 11 23:07:32.115472 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.115368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:32.115472 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.115411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:32.115677 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.115534 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:32.115677 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.115559 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:32.115677 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.115596 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret podName:21c80d7a-b6b4-4596-a631-ca2d9023a695 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:33.11557922 +0000 UTC m=+4.012045279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret") pod "global-pull-secret-syncer-v54pq" (UID: "21c80d7a-b6b4-4596-a631-ca2d9023a695") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:32.115677 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.115626 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:33.115606458 +0000 UTC m=+4.012072515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:32.216132 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.216087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:32.216301 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.216272 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:32.216301 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.216295 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:32.216417 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.216310 2581 projected.go:196] Error preparing data for projected volume kube-api-access-8czpw for pod openshift-network-diagnostics/network-check-target-jmw2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:32.216417 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.216378 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw podName:71cff971-145d-499a-9807-a51e8eadda63 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:33.216357608 +0000 UTC m=+4.112823670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8czpw" (UniqueName: "kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw") pod "network-check-target-jmw2c" (UID: "71cff971-145d-499a-9807-a51e8eadda63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:32.400066 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:32.400041 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3803699b_9579_4159_9374_ed639ed00c35.slice/crio-9fcdee6e34789f5ad5a34f9ec3718903b77295054165d30222c64178f1fcd0e5 WatchSource:0}: Error finding container 9fcdee6e34789f5ad5a34f9ec3718903b77295054165d30222c64178f1fcd0e5: Status 404 returned error can't find the container with id 9fcdee6e34789f5ad5a34f9ec3718903b77295054165d30222c64178f1fcd0e5 Jun 11 23:07:32.401882 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:32.401853 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d22ad7_718d_41af_9afb_5d5432ddc04a.slice/crio-628573340ab1accae3c41a956a4d9b8ecfaeb9dd3086720acd2e66ab6d27799b WatchSource:0}: Error finding container 628573340ab1accae3c41a956a4d9b8ecfaeb9dd3086720acd2e66ab6d27799b: Status 404 returned error can't find the container with id 628573340ab1accae3c41a956a4d9b8ecfaeb9dd3086720acd2e66ab6d27799b Jun 11 23:07:32.405329 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:32.405303 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcf1664_9e8a_4555_a787_6b709f4e8cd0.slice/crio-4cad028c079e019cd620ea6d41e886a295cddaf2ab4ce6aa4e1eedf55b0d65c8 WatchSource:0}: Error finding container 4cad028c079e019cd620ea6d41e886a295cddaf2ab4ce6aa4e1eedf55b0d65c8: Status 404 returned error can't find the container with id 4cad028c079e019cd620ea6d41e886a295cddaf2ab4ce6aa4e1eedf55b0d65c8 Jun 11 23:07:32.406041 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:32.406017 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d75fb5c_1713_4cfd_94bd_9fb67342173a.slice/crio-0b66859804ba0caaa05d459168a629d157cf7f3fc95ea4f91cc38aa7e55ff9ab WatchSource:0}: Error finding container 0b66859804ba0caaa05d459168a629d157cf7f3fc95ea4f91cc38aa7e55ff9ab: Status 404 returned error can't find the container with id 0b66859804ba0caaa05d459168a629d157cf7f3fc95ea4f91cc38aa7e55ff9ab Jun 11 23:07:32.410312 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:32.407261 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode236869f_8f00_433a_af4d_025a7112d99d.slice/crio-05909150120dc6e400523efcaef19833a5f27f66d8ae9da004ba521dd6c54d82 WatchSource:0}: Error finding container 05909150120dc6e400523efcaef19833a5f27f66d8ae9da004ba521dd6c54d82: Status 404 returned error can't find the container with id 05909150120dc6e400523efcaef19833a5f27f66d8ae9da004ba521dd6c54d82 Jun 11 23:07:32.410312 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:32.408168 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090f26b9_5ce0_4dee_875f_9b50918297f1.slice/crio-cb10872f05b841136fcaa4bfe98c50b077fd1cd237247d3b21b73dbca32b0939 WatchSource:0}: Error finding container cb10872f05b841136fcaa4bfe98c50b077fd1cd237247d3b21b73dbca32b0939: Status 404 returned error can't find the container with id cb10872f05b841136fcaa4bfe98c50b077fd1cd237247d3b21b73dbca32b0939 Jun 11 23:07:32.410312 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:07:32.409705 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69030a61_4820_4cbc_b2af_24cf40f5a6a5.slice/crio-fc48702cd64ef3e436fbf3bfdcdcea9e252aedba251c56ae67971a67939ad122 WatchSource:0}: Error finding container fc48702cd64ef3e436fbf3bfdcdcea9e252aedba251c56ae67971a67939ad122: Status 404 returned error can't find the container with id fc48702cd64ef3e436fbf3bfdcdcea9e252aedba251c56ae67971a67939ad122 Jun 11 23:07:32.543262 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.543187 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:02:31 +0000 UTC" deadline="2027-11-17 01:05:09.205583944 +0000 UTC" Jun 11 23:07:32.543262 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.543260 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12553h57m36.66233039s" Jun 11 23:07:32.565498 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.565474 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:32.565630 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:32.565590 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:32.573705 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.573674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" event={"ID":"39a67b469fc72ec0b31210c0d3168786","Type":"ContainerStarted","Data":"c69a48c6a003b760c4d920c7ac441ed8981fd37f5534cb0844fc909e7db4f565"} Jun 11 23:07:32.574756 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.574727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-znj4l" event={"ID":"eac0f764-298c-48eb-822e-f46def43a74a","Type":"ContainerStarted","Data":"1dadc07300cf7a17190c4026c120adf862073ef9a525ce5f1bf74d6f33cee51b"} Jun 11 23:07:32.575970 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.575948 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5lf6p" event={"ID":"4d75fb5c-1713-4cfd-94bd-9fb67342173a","Type":"ContainerStarted","Data":"0b66859804ba0caaa05d459168a629d157cf7f3fc95ea4f91cc38aa7e55ff9ab"} Jun 11 23:07:32.577112 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.577092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" event={"ID":"9610ba9d-2fd0-409f-9002-4f23144dd4aa","Type":"ContainerStarted","Data":"e7290339d926efe63d571a65275bf34ac7faf62a32cb764d423546f53b3cf84b"} Jun 11 23:07:32.578209 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.578184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" event={"ID":"090f26b9-5ce0-4dee-875f-9b50918297f1","Type":"ContainerStarted","Data":"cb10872f05b841136fcaa4bfe98c50b077fd1cd237247d3b21b73dbca32b0939"} Jun 11 23:07:32.579441 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.579418 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"05909150120dc6e400523efcaef19833a5f27f66d8ae9da004ba521dd6c54d82"} Jun 11 23:07:32.580813 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.580766 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fpc67" event={"ID":"5dcf1664-9e8a-4555-a787-6b709f4e8cd0","Type":"ContainerStarted","Data":"4cad028c079e019cd620ea6d41e886a295cddaf2ab4ce6aa4e1eedf55b0d65c8"} Jun 11 23:07:32.581811 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.581791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7lhr9" event={"ID":"e3d22ad7-718d-41af-9afb-5d5432ddc04a","Type":"ContainerStarted","Data":"628573340ab1accae3c41a956a4d9b8ecfaeb9dd3086720acd2e66ab6d27799b"} Jun 11 23:07:32.582848 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.582827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerStarted","Data":"fc48702cd64ef3e436fbf3bfdcdcea9e252aedba251c56ae67971a67939ad122"} Jun 11 23:07:32.583919 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.583899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jcgbd" event={"ID":"3803699b-9579-4159-9374-ed639ed00c35","Type":"ContainerStarted","Data":"9fcdee6e34789f5ad5a34f9ec3718903b77295054165d30222c64178f1fcd0e5"} Jun 11 23:07:32.588206 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:32.588157 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" podStartSLOduration=2.58814124 podStartE2EDuration="2.58814124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:32.587756288 +0000 UTC m=+3.484222352" watchObservedRunningTime="2026-06-11 23:07:32.58814124 +0000 UTC m=+3.484607305" Jun 11 23:07:33.125944 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.124938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:33.125944 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.125099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:33.125944 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.125250 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:33.125944 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.125350 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:35.125330794 +0000 UTC m=+6.021796857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:33.125944 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.125810 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:33.125944 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.125858 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret podName:21c80d7a-b6b4-4596-a631-ca2d9023a695 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:35.125841762 +0000 UTC m=+6.022307819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret") pod "global-pull-secret-syncer-v54pq" (UID: "21c80d7a-b6b4-4596-a631-ca2d9023a695") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:33.226836 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.225929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:33.226836 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.226135 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:33.226836 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.226154 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:33.226836 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.226167 2581 projected.go:196] Error preparing data for projected volume kube-api-access-8czpw for pod openshift-network-diagnostics/network-check-target-jmw2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:33.226836 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.226223 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw podName:71cff971-145d-499a-9807-a51e8eadda63 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:35.226205983 +0000 UTC m=+6.122672042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8czpw" (UniqueName: "kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw") pod "network-check-target-jmw2c" (UID: "71cff971-145d-499a-9807-a51e8eadda63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:33.544510 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.544385 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:02:31 +0000 UTC" deadline="2028-03-26 03:18:17.608032142 +0000 UTC" Jun 11 23:07:33.544510 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.544461 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15676h10m44.06359013s" Jun 11 23:07:33.565945 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.565918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:33.566102 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.566061 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:33.566550 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.566530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:33.566650 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:33.566625 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:33.612595 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.612560 2581 generic.go:356] "Generic (PLEG): container finished" podID="679142bdec860e0cfe96636537cb79b1" containerID="ef7e8dcb62012a029d7630d876768277fe5797227a1323a7aebb22c09f48019b" exitCode=0 Jun 11 23:07:33.613290 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:33.613079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" event={"ID":"679142bdec860e0cfe96636537cb79b1","Type":"ContainerDied","Data":"ef7e8dcb62012a029d7630d876768277fe5797227a1323a7aebb22c09f48019b"} Jun 11 23:07:34.566038 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:34.566008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:34.566522 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:34.566145 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:34.654917 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:34.654108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" event={"ID":"679142bdec860e0cfe96636537cb79b1","Type":"ContainerStarted","Data":"e9db08be14fd6733d61eb73fdcec8458a7d32910fba629f4fb717635778fd23a"} Jun 11 23:07:35.141903 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:35.141859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:35.142100 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:35.141943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:35.142157 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.142141 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:35.142211 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.142202 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret podName:21c80d7a-b6b4-4596-a631-ca2d9023a695 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:39.142185239 +0000 UTC m=+10.038651296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret") pod "global-pull-secret-syncer-v54pq" (UID: "21c80d7a-b6b4-4596-a631-ca2d9023a695") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:35.142622 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.142599 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:35.142719 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.142665 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:39.14264713 +0000 UTC m=+10.039113198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:35.242847 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:35.242808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:35.243024 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.242975 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:35.243024 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.242997 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:35.243024 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.243010 2581 projected.go:196] Error preparing data for projected volume kube-api-access-8czpw for pod openshift-network-diagnostics/network-check-target-jmw2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:35.243163 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.243069 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw podName:71cff971-145d-499a-9807-a51e8eadda63 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:39.243048591 +0000 UTC m=+10.139514649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8czpw" (UniqueName: "kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw") pod "network-check-target-jmw2c" (UID: "71cff971-145d-499a-9807-a51e8eadda63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:35.566712 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:35.566611 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:35.567148 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.566771 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:35.567148 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:35.566820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:35.571696 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:35.571660 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:36.566208 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:36.566174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:36.566382 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:36.566310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:37.566140 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:37.566109 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:37.566577 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:37.566224 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:37.566577 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:37.566264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:37.566577 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:37.566383 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:38.566177 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:38.566146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:38.566677 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:38.566282 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:39.178059 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:39.178020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:39.178233 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:39.178078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:39.178233 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.178175 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:39.178319 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.178243 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:47.178222406 +0000 UTC m=+18.074688452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:39.178319 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.178262 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:39.178319 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.178305 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret podName:21c80d7a-b6b4-4596-a631-ca2d9023a695 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:47.178294372 +0000 UTC m=+18.074760414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret") pod "global-pull-secret-syncer-v54pq" (UID: "21c80d7a-b6b4-4596-a631-ca2d9023a695") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:39.279138 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:39.279094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:39.279341 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.279257 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:39.279341 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.279288 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:39.279341 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.279301 2581 projected.go:196] Error preparing data for projected volume kube-api-access-8czpw for pod openshift-network-diagnostics/network-check-target-jmw2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:39.279493 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.279362 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw podName:71cff971-145d-499a-9807-a51e8eadda63 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:47.279343176 +0000 UTC m=+18.175809224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8czpw" (UniqueName: "kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw") pod "network-check-target-jmw2c" (UID: "71cff971-145d-499a-9807-a51e8eadda63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:39.566079 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:39.566002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:39.566304 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.566134 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:39.566304 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:39.566227 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:39.566721 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:39.566339 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:40.565349 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:40.565295 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:40.565603 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:40.565433 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:41.567246 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:41.566575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:41.567246 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:41.566726 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:41.567246 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:41.567111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:41.567246 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:41.567200 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:42.565656 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:42.565620 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:42.565850 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:42.565753 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:43.565666 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:43.565632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:43.566146 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:43.565632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:43.566146 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:43.565763 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:43.566146 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:43.565800 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:44.565951 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:44.565913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:44.566517 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:44.566017 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:45.565647 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:45.565606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:45.565834 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:45.565747 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:45.565834 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:45.565797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:45.565942 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:45.565885 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:46.566152 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:46.566120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:46.566558 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:46.566231 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:47.238417 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:47.238382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:47.238589 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:47.238426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:47.238589 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.238560 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:47.238589 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.238567 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:47.238711 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.238613 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret podName:21c80d7a-b6b4-4596-a631-ca2d9023a695 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:03.238600356 +0000 UTC m=+34.135066398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret") pod "global-pull-secret-syncer-v54pq" (UID: "21c80d7a-b6b4-4596-a631-ca2d9023a695") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:47.238711 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.238627 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:03.238620254 +0000 UTC m=+34.135086297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:47.339213 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:47.339173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:47.339416 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.339327 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:47.339416 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.339347 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:47.339416 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.339359 2581 projected.go:196] Error preparing data for projected volume kube-api-access-8czpw for pod openshift-network-diagnostics/network-check-target-jmw2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:47.339608 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.339431 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw podName:71cff971-145d-499a-9807-a51e8eadda63 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:03.339412988 +0000 UTC m=+34.235879047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8czpw" (UniqueName: "kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw") pod "network-check-target-jmw2c" (UID: "71cff971-145d-499a-9807-a51e8eadda63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:47.568642 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:47.568560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:47.569026 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.568675 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:47.569026 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:47.568761 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:47.569026 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:47.568856 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:48.565411 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:48.565373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:48.565610 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:48.565507 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:49.568950 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:49.568918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:49.569410 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:49.568929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:49.569410 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:49.569017 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:49.569410 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:49.569124 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:50.565715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:50.565684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:50.565888 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:50.565807 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:51.568176 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.567995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:51.568799 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.568046 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:51.568799 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:51.568253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:51.568799 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:51.568312 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:51.693713 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.693252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerStarted","Data":"aa261b3a4a2696bfc5415714877993b1bee093ce3abc670f4ec94af823c1f480"} Jun 11 23:07:51.695818 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.695785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jcgbd" event={"ID":"3803699b-9579-4159-9374-ed639ed00c35","Type":"ContainerStarted","Data":"99584914ba93743d6652f905a845208df1f64d294c641312c90fc5042e13f48f"} Jun 11 23:07:51.697486 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.697434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-znj4l" event={"ID":"eac0f764-298c-48eb-822e-f46def43a74a","Type":"ContainerStarted","Data":"ea4d3cce47060b31ffbf5365c1642d4a9b52827c9c70e3d4a983165a778783b0"} Jun 11 23:07:51.699207 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.699184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5lf6p" event={"ID":"4d75fb5c-1713-4cfd-94bd-9fb67342173a","Type":"ContainerStarted","Data":"7a2f4d39328d852764fbba768ee834fcad2433d0bad1f1e96ddbce99faed52ec"} Jun 11 23:07:51.700848 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.700818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" event={"ID":"9610ba9d-2fd0-409f-9002-4f23144dd4aa","Type":"ContainerStarted","Data":"7b1e70458f416aa0b11eb67ff43084b0beab5054093ce45bf7f525e9180d9a20"} Jun 11 23:07:51.702393 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.702368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" event={"ID":"090f26b9-5ce0-4dee-875f-9b50918297f1","Type":"ContainerStarted","Data":"1b9f8683791b13b2f239df9d2f32012a246f9682def7ad6b0081ad86702d8973"} Jun 11 23:07:51.704501 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.704478 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:07:51.704833 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.704812 2581 generic.go:356] "Generic (PLEG): container finished" podID="e236869f-8f00-433a-af4d-025a7112d99d" containerID="4414c03f471c8977ecb8c041131aaf9fe35a79b9baa0045c25483ba9a9ceea1d" exitCode=1 Jun 11 23:07:51.704894 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.704878 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"b5625ad44258f7a9c1da921cccc6619cafd1d33fc571f0d9bb8d02bb76ba1c71"} Jun 11 23:07:51.704952 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.704940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerDied","Data":"4414c03f471c8977ecb8c041131aaf9fe35a79b9baa0045c25483ba9a9ceea1d"} Jun 11 23:07:51.705003 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.704992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"aa60de651940b242494261bbe22c7cba7648de3d2c84b7089cffdd47d369653f"} Jun 11 23:07:51.706718 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.706693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fpc67" event={"ID":"5dcf1664-9e8a-4555-a787-6b709f4e8cd0","Type":"ContainerStarted","Data":"b15c16b08af8682bc3e15378abe52666984d1a96d5b9f778530775c050b9ee37"} Jun 11 23:07:51.715257 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.715217 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" podStartSLOduration=21.715204195 podStartE2EDuration="21.715204195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:34.670263185 +0000 UTC m=+5.566729250" watchObservedRunningTime="2026-06-11 23:07:51.715204195 +0000 UTC m=+22.611670258" Jun 11 23:07:51.730236 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.730198 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fpc67" podStartSLOduration=3.840599905 podStartE2EDuration="22.730184582s" totalImagesPullingTime="18.889584677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:51.729839466 +0000 UTC m=+22.626305529" watchObservedRunningTime="2026-06-11 23:07:51.730184582 +0000 UTC m=+22.626650624" Jun 11 23:07:51.744493 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.744434 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xjwxl" podStartSLOduration=3.906477324 podStartE2EDuration="22.744417851s" totalImagesPullingTime="18.837940527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:51.74426015 +0000 UTC m=+22.640726215" watchObservedRunningTime="2026-06-11 23:07:51.744417851 +0000 UTC m=+22.640883916" Jun 11 23:07:51.758864 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.758814 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5lf6p" podStartSLOduration=3.920208783 podStartE2EDuration="22.758800318s" totalImagesPullingTime="18.838591535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:51.758548893 +0000 UTC m=+22.655014956" watchObservedRunningTime="2026-06-11 23:07:51.758800318 +0000 UTC m=+22.655266382" Jun 11 23:07:51.773095 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.773054 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jcgbd" podStartSLOduration=12.269028346 podStartE2EDuration="22.773042278s" totalImagesPullingTime="10.504013932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:51.772938806 +0000 UTC m=+22.669404869" watchObservedRunningTime="2026-06-11 23:07:51.773042278 +0000 UTC m=+22.669508336" Jun 11 23:07:51.792911 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:51.792865 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-znj4l" podStartSLOduration=3.960019452 podStartE2EDuration="22.79284922s" totalImagesPullingTime="18.832829768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:51.792485015 +0000 UTC m=+22.688951081" watchObservedRunningTime="2026-06-11 23:07:51.79284922 +0000 UTC m=+22.689315356" Jun 11 23:07:52.329951 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.329916 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 23:07:52.565595 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.565557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:52.565769 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:52.565662 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:52.579939 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.579845 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T23:07:52.329950181Z","UUID":"bb67fdca-b492-4ebf-8744-d12eaee73f40","Handler":null,"Name":"","Endpoint":""} Jun 11 23:07:52.581567 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.581543 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 23:07:52.581675 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.581577 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 23:07:52.616442 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.616407 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:52.616989 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.616968 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:52.710235 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.710193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" event={"ID":"9610ba9d-2fd0-409f-9002-4f23144dd4aa","Type":"ContainerStarted","Data":"d21ffbf0eef4d8f99001bde8e733ea1352d8a7ab3ffe9790d9617746c9e0a678"} Jun 11 23:07:52.712549 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.712529 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:07:52.712888 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.712867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"b7c25bcb93381bc32f80c393ac5eed739f641c0eee1e6edd4f2f6cd5ba6b2588"} Jun 11 23:07:52.712982 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.712944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"ba5e4ee3ceb6d5baf94b4825db936c2d6b64e2fc66ea5a51b947a7ef2e37a5d6"} Jun 11 23:07:52.713048 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.712996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"9029320318e87e45d822ba5b608b407b274287ae2b9068159924f6e16ff67c5c"} Jun 11 23:07:52.714238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.714218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7lhr9" event={"ID":"e3d22ad7-718d-41af-9afb-5d5432ddc04a","Type":"ContainerStarted","Data":"879672523cb28620917836d0655e6eb9f2e862ca21f97363fcaec859ec7faaf4"} Jun 11 23:07:52.715665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.715645 2581 generic.go:356] "Generic (PLEG): container finished" podID="69030a61-4820-4cbc-b2af-24cf40f5a6a5" containerID="aa261b3a4a2696bfc5415714877993b1bee093ce3abc670f4ec94af823c1f480" exitCode=0 Jun 11 23:07:52.715748 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.715731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerDied","Data":"aa261b3a4a2696bfc5415714877993b1bee093ce3abc670f4ec94af823c1f480"} Jun 11 23:07:52.715821 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.715804 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:52.716428 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.716414 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jcgbd" Jun 11 23:07:52.728805 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:52.728769 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7lhr9" podStartSLOduration=4.885470243 podStartE2EDuration="23.72875762s" totalImagesPullingTime="18.843287377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:52.72838355 +0000 UTC m=+23.624849614" watchObservedRunningTime="2026-06-11 23:07:52.72875762 +0000 UTC m=+23.625223683" Jun 11 23:07:53.565972 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:53.565884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:53.566135 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:53.566007 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:53.566331 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:53.565884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:53.566471 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:53.566413 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:53.721057 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:53.721006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" event={"ID":"9610ba9d-2fd0-409f-9002-4f23144dd4aa","Type":"ContainerStarted","Data":"73808b8666e06a51a2b239aed1c721f73b6950a0be9ab0ca2232a34a9c08f9fc"} Jun 11 23:07:53.738444 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:53.738391 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllh8" podStartSLOduration=4.186933985 podStartE2EDuration="24.738377492s" totalImagesPullingTime="20.551443507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:53.737996224 +0000 UTC m=+24.634462287" watchObservedRunningTime="2026-06-11 23:07:53.738377492 +0000 UTC m=+24.634843555" Jun 11 23:07:54.566135 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:54.566100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:54.566323 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:54.566238 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:54.726560 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:54.726533 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:07:54.727106 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:54.726936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"0cd748af77c36293af48e7d950f72989b9a323f2a7bd0f01d34e91c6c9a71eaf"} Jun 11 23:07:55.568552 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:55.568522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:55.568713 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:55.568624 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:55.568713 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:55.568692 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:55.568804 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:55.568788 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:56.565219 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:56.565184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:56.565763 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:56.565313 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:57.565965 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:57.565927 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:57.565965 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:57.565960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:57.566349 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:57.566067 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:57.566349 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:57.566190 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:57.738478 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:57.738251 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:07:57.738958 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:57.738861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"d46f6b6a1266424544f20b25f2491255d52bce5ba08fa45605f2afa33d2c7711"} Jun 11 23:07:58.566122 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.566036 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:58.566625 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:58.566166 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:58.742797 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.742765 2581 generic.go:356] "Generic (PLEG): container finished" podID="69030a61-4820-4cbc-b2af-24cf40f5a6a5" containerID="4d4f1f7cdb93589edc18a83d3cbd449780c86f922ef22578b6044eccb215f94c" exitCode=0 Jun 11 23:07:58.742972 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.742850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerDied","Data":"4d4f1f7cdb93589edc18a83d3cbd449780c86f922ef22578b6044eccb215f94c"} Jun 11 23:07:58.743310 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.743287 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:58.743430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.743375 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:58.743430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.743425 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:58.744176 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.743479 2581 scope.go:117] "RemoveContainer" containerID="4414c03f471c8977ecb8c041131aaf9fe35a79b9baa0045c25483ba9a9ceea1d" Jun 11 23:07:58.762147 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.762125 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:58.762349 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:58.762330 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:07:59.567433 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.567183 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:59.568084 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:59.567556 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:59.568182 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.568162 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:59.568321 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:59.568299 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:59.663045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.663017 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v54pq"] Jun 11 23:07:59.663168 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.663139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:07:59.663269 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:59.663228 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:07:59.665816 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.665775 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggh42"] Jun 11 23:07:59.666378 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.666356 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jmw2c"] Jun 11 23:07:59.749119 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.749043 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:07:59.749477 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.749435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" event={"ID":"e236869f-8f00-433a-af4d-025a7112d99d","Type":"ContainerStarted","Data":"5519d5981e6a064b2f2c4d9ea7849308a3e1998ffce8a41fe48a206a08ab0b56"} Jun 11 23:07:59.751633 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.751607 2581 generic.go:356] "Generic (PLEG): container finished" podID="69030a61-4820-4cbc-b2af-24cf40f5a6a5" containerID="a9c77c87e587323b061791cf91298e5c605f3ade0650ff261c2073c8e71e44e7" exitCode=0 Jun 11 23:07:59.751739 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.751678 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:07:59.751739 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.751681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerDied","Data":"a9c77c87e587323b061791cf91298e5c605f3ade0650ff261c2073c8e71e44e7"} Jun 11 23:07:59.751844 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:59.751785 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:07:59.751844 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.751816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:07:59.751945 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:07:59.751899 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:07:59.781686 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:07:59.781639 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" podStartSLOduration=11.897599476 podStartE2EDuration="30.781623238s" totalImagesPullingTime="18.884023762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:59.780566803 +0000 UTC m=+30.677032867" watchObservedRunningTime="2026-06-11 23:07:59.781623238 +0000 UTC m=+30.678089301" Jun 11 23:08:01.568180 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:01.568150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:01.568752 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:01.568276 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:08:01.568752 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:01.568273 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:08:01.568752 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:01.568281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:08:01.568752 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:01.568349 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:08:01.568752 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:01.568406 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:08:01.759196 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:01.759157 2581 generic.go:356] "Generic (PLEG): container finished" podID="69030a61-4820-4cbc-b2af-24cf40f5a6a5" containerID="38913933cfc2e078bc6af2b24c9754a117d73a9f54fd5f91532f95d631f2ed72" exitCode=0 Jun 11 23:08:01.759365 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:01.759208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerDied","Data":"38913933cfc2e078bc6af2b24c9754a117d73a9f54fd5f91532f95d631f2ed72"} Jun 11 23:08:03.254729 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:03.254497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:08:03.255307 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.254638 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:08:03.255307 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:03.254822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:08:03.255307 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.254885 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret podName:21c80d7a-b6b4-4596-a631-ca2d9023a695 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:35.254859168 +0000 UTC m=+66.151325233 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret") pod "global-pull-secret-syncer-v54pq" (UID: "21c80d7a-b6b4-4596-a631-ca2d9023a695") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:08:03.255307 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.254915 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:08:03.255307 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.254955 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:35.254939547 +0000 UTC m=+66.151405589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:08:03.355592 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:03.355556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:03.355818 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.355677 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:08:03.355818 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.355695 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:08:03.355818 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.355703 2581 projected.go:196] Error preparing data for projected volume kube-api-access-8czpw for pod openshift-network-diagnostics/network-check-target-jmw2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:08:03.355818 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.355754 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw podName:71cff971-145d-499a-9807-a51e8eadda63 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:35.355737839 +0000 UTC m=+66.252203881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8czpw" (UniqueName: "kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw") pod "network-check-target-jmw2c" (UID: "71cff971-145d-499a-9807-a51e8eadda63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:08:03.565563 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:03.565485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:08:03.565731 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:03.565493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:08:03.565731 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:03.565628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:03.565731 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.565609 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:08:03.565899 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.565728 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v54pq" podUID="21c80d7a-b6b4-4596-a631-ca2d9023a695" Jun 11 23:08:03.565899 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:03.565814 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmw2c" podUID="71cff971-145d-499a-9807-a51e8eadda63" Jun 11 23:08:04.362809 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.362778 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeReady" Jun 11 23:08:04.363300 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.362923 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 23:08:04.406767 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.406729 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qgwfn"] Jun 11 23:08:04.431934 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.431898 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tqw5b"] Jun 11 23:08:04.432112 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.432036 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.434914 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.434883 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 23:08:04.435053 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.435031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 23:08:04.438311 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.437329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p6jbq\"" Jun 11 23:08:04.449864 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.449833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgwfn"] Jun 11 23:08:04.449962 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.449875 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tqw5b"] Jun 11 23:08:04.450029 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.449957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.453534 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.453514 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 23:08:04.453644 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.453535 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 23:08:04.453644 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.453553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 23:08:04.453795 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.453778 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rzkf\"" Jun 11 23:08:04.564232 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.564200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.564428 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.564260 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghfn\" (UniqueName: \"kubernetes.io/projected/5d387853-ec92-498d-853f-afde2c823804-kube-api-access-8ghfn\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.564428 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.564288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d387853-ec92-498d-853f-afde2c823804-config-volume\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.564428 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.564305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6t8l\" (UniqueName: \"kubernetes.io/projected/1b172de2-3457-48e3-98e0-a01f44d0805e-kube-api-access-g6t8l\") pod \"ingress-canary-tqw5b\" (UID: \"1b172de2-3457-48e3-98e0-a01f44d0805e\") " pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.564428 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.564322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b172de2-3457-48e3-98e0-a01f44d0805e-cert\") pod \"ingress-canary-tqw5b\" (UID: \"1b172de2-3457-48e3-98e0-a01f44d0805e\") " pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.564428 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.564340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d387853-ec92-498d-853f-afde2c823804-tmp-dir\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.665548 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.665462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.665706 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.665579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghfn\" (UniqueName: \"kubernetes.io/projected/5d387853-ec92-498d-853f-afde2c823804-kube-api-access-8ghfn\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.665706 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:04.665583 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:04.665706 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.665620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d387853-ec92-498d-853f-afde2c823804-config-volume\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.665706 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:04.665651 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:05.165628229 +0000 UTC m=+36.062094276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:08:04.665706 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.665679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6t8l\" (UniqueName: \"kubernetes.io/projected/1b172de2-3457-48e3-98e0-a01f44d0805e-kube-api-access-g6t8l\") pod \"ingress-canary-tqw5b\" (UID: \"1b172de2-3457-48e3-98e0-a01f44d0805e\") " pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.665951 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.665709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b172de2-3457-48e3-98e0-a01f44d0805e-cert\") pod \"ingress-canary-tqw5b\" (UID: \"1b172de2-3457-48e3-98e0-a01f44d0805e\") " pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.665951 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.665744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d387853-ec92-498d-853f-afde2c823804-tmp-dir\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.666093 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.666067 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d387853-ec92-498d-853f-afde2c823804-tmp-dir\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.666220 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.666201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d387853-ec92-498d-853f-afde2c823804-config-volume\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.670930 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.670900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b172de2-3457-48e3-98e0-a01f44d0805e-cert\") pod \"ingress-canary-tqw5b\" (UID: \"1b172de2-3457-48e3-98e0-a01f44d0805e\") " pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.674223 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.674197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghfn\" (UniqueName: \"kubernetes.io/projected/5d387853-ec92-498d-853f-afde2c823804-kube-api-access-8ghfn\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:04.674342 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.674326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6t8l\" (UniqueName: \"kubernetes.io/projected/1b172de2-3457-48e3-98e0-a01f44d0805e-kube-api-access-g6t8l\") pod \"ingress-canary-tqw5b\" (UID: \"1b172de2-3457-48e3-98e0-a01f44d0805e\") " pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.760084 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.760042 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tqw5b" Jun 11 23:08:04.977340 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:04.977267 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tqw5b"] Jun 11 23:08:05.169728 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.169688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:05.169919 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:05.169814 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:05.169919 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:05.169880 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:06.169859695 +0000 UTC m=+37.066325743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:08:05.565719 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.565680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:05.565719 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.565711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:08:05.566249 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.565699 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:08:05.568297 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.568272 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hzjk5\"" Jun 11 23:08:05.569304 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.569282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:08:05.569304 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.569301 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nchnx\"" Jun 11 23:08:05.569592 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.569576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:08:05.569763 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.569749 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:08:05.569944 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:05.569927 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:08:06.176862 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:06.176818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:06.177078 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:06.176955 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:06.177078 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:06.177034 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:08.177012457 +0000 UTC m=+39.073478506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:08:06.524649 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:08:06.524580 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b172de2_3457_48e3_98e0_a01f44d0805e.slice/crio-fcda5ce8d043879acf4389c7d91294cc405be7b7b0e3e6dd8fd05a13fda09fe6 WatchSource:0}: Error finding container fcda5ce8d043879acf4389c7d91294cc405be7b7b0e3e6dd8fd05a13fda09fe6: Status 404 returned error can't find the container with id fcda5ce8d043879acf4389c7d91294cc405be7b7b0e3e6dd8fd05a13fda09fe6 Jun 11 23:08:06.772641 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:06.772606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tqw5b" event={"ID":"1b172de2-3457-48e3-98e0-a01f44d0805e","Type":"ContainerStarted","Data":"fcda5ce8d043879acf4389c7d91294cc405be7b7b0e3e6dd8fd05a13fda09fe6"} Jun 11 23:08:07.778187 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:07.777958 2581 generic.go:356] "Generic (PLEG): container finished" podID="69030a61-4820-4cbc-b2af-24cf40f5a6a5" containerID="f5489ec43a4540bdc3b01f074cbe09c61207ef41270f1fb0f6aab2dd595203eb" exitCode=0 Jun 11 23:08:07.778648 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:07.778056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerDied","Data":"f5489ec43a4540bdc3b01f074cbe09c61207ef41270f1fb0f6aab2dd595203eb"} Jun 11 23:08:08.196398 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:08.196353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:08.196585 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:08.196532 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:08.196642 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:08.196603 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:12.19658174 +0000 UTC m=+43.093047805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:08:08.783973 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:08.783884 2581 generic.go:356] "Generic (PLEG): container finished" podID="69030a61-4820-4cbc-b2af-24cf40f5a6a5" containerID="d8f6736b5838573dd6a8dbc4cb7b37e8763da471a777f091b0cc4a60aef3478d" exitCode=0 Jun 11 23:08:08.784586 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:08.783967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerDied","Data":"d8f6736b5838573dd6a8dbc4cb7b37e8763da471a777f091b0cc4a60aef3478d"} Jun 11 23:08:08.785354 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:08.785327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tqw5b" event={"ID":"1b172de2-3457-48e3-98e0-a01f44d0805e","Type":"ContainerStarted","Data":"f768d25da60fed82933742c87684c2385a8db006da1b9608ef6f97f2d764e666"} Jun 11 23:08:08.822980 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:08.822932 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tqw5b" podStartSLOduration=2.934355287 podStartE2EDuration="4.822914916s" totalImagesPullingTime="1.888559629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:08.821747204 +0000 UTC m=+39.718213281" watchObservedRunningTime="2026-06-11 23:08:08.822914916 +0000 UTC m=+39.719380980" Jun 11 23:08:09.790844 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:09.790805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" event={"ID":"69030a61-4820-4cbc-b2af-24cf40f5a6a5","Type":"ContainerStarted","Data":"03d0649c089af40cac50bb4f74ee6f65b81b757d5b64c8d66f5f7e5ff3aa920a"} Jun 11 23:08:12.226918 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:12.226865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:12.227309 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:12.227027 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:12.227309 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:12.227096 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:20.227079095 +0000 UTC m=+51.123545142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:08:20.280153 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:20.280115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:20.280734 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:20.280277 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:20.280734 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:20.280360 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:36.280344164 +0000 UTC m=+67.176810210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:08:30.765023 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:30.764996 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfgz7" Jun 11 23:08:30.794037 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:30.793998 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wvwj8" podStartSLOduration=30.870479424 podStartE2EDuration="1m1.793985278s" totalImagesPullingTime="30.923505854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:09.815692978 +0000 UTC m=+40.712159042" watchObservedRunningTime="2026-06-11 23:08:30.793985278 +0000 UTC m=+61.690451392" Jun 11 23:08:31.358490 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.358439 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w"] Jun 11 23:08:31.362577 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.362557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.364918 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.364887 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 23:08:31.365046 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.365008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 23:08:31.365171 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.365155 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 23:08:31.365250 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.365228 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 23:08:31.367083 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.367061 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm"] Jun 11 23:08:31.369116 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.368728 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.370268 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.370248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w"] Jun 11 23:08:31.371101 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.371082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 23:08:31.371193 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.371124 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 23:08:31.371258 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.371130 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 23:08:31.371258 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.371195 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 23:08:31.383621 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.383601 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm"] Jun 11 23:08:31.454419 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-hub\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.454561 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.454561 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2pbq\" (UniqueName: \"kubernetes.io/projected/90024595-1411-443b-af55-2870195919f0-kube-api-access-q2pbq\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.454561 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-tmp\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.454665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-ca\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.454665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhxg6\" (UniqueName: \"kubernetes.io/projected/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-kube-api-access-rhxg6\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.454665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.454755 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-klusterlet-config\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.454755 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.454717 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90024595-1411-443b-af55-2870195919f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.555364 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-klusterlet-config\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.555364 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90024595-1411-443b-af55-2870195919f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.555636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-hub\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.555636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.555636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pbq\" (UniqueName: \"kubernetes.io/projected/90024595-1411-443b-af55-2870195919f0-kube-api-access-q2pbq\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.555636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-tmp\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.555636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-ca\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.555636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhxg6\" (UniqueName: \"kubernetes.io/projected/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-kube-api-access-rhxg6\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.555636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.555586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.556073 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.556024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-tmp\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.556205 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.556187 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90024595-1411-443b-af55-2870195919f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.559111 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.559091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.559298 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.559280 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-ca\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.559514 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.559495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.559556 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.559517 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90024595-1411-443b-af55-2870195919f0-hub\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.559556 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.559542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-klusterlet-config\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.565030 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.565002 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pbq\" (UniqueName: \"kubernetes.io/projected/90024595-1411-443b-af55-2870195919f0-kube-api-access-q2pbq\") pod \"cluster-proxy-proxy-agent-7d554bb445-fntqm\" (UID: \"90024595-1411-443b-af55-2870195919f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.566125 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.566104 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhxg6\" (UniqueName: \"kubernetes.io/projected/b0b86a6b-0125-4a5b-bee2-8222a3698c3e-kube-api-access-rhxg6\") pod \"klusterlet-addon-workmgr-68d8bf8f85-2ng8w\" (UID: \"b0b86a6b-0125-4a5b-bee2-8222a3698c3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.673006 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.672918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:31.695244 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.695214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:08:31.803628 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.803546 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w"] Jun 11 23:08:31.807434 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:08:31.807401 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b86a6b_0125_4a5b_bee2_8222a3698c3e.slice/crio-c9144f0c8bcd53c1cf070520b3c22f6fc7d4b96e6a40d8f01b76fc799176ccd4 WatchSource:0}: Error finding container c9144f0c8bcd53c1cf070520b3c22f6fc7d4b96e6a40d8f01b76fc799176ccd4: Status 404 returned error can't find the container with id c9144f0c8bcd53c1cf070520b3c22f6fc7d4b96e6a40d8f01b76fc799176ccd4 Jun 11 23:08:31.826089 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.826060 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm"] Jun 11 23:08:31.830128 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:08:31.829720 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90024595_1411_443b_af55_2870195919f0.slice/crio-c69bed063828354d1028c2b286a5d6f260e9956599627465dffcbbe50c6beb3f WatchSource:0}: Error finding container c69bed063828354d1028c2b286a5d6f260e9956599627465dffcbbe50c6beb3f: Status 404 returned error can't find the container with id c69bed063828354d1028c2b286a5d6f260e9956599627465dffcbbe50c6beb3f Jun 11 23:08:31.844659 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.844626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" event={"ID":"90024595-1411-443b-af55-2870195919f0","Type":"ContainerStarted","Data":"c69bed063828354d1028c2b286a5d6f260e9956599627465dffcbbe50c6beb3f"} Jun 11 23:08:31.845634 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:31.845614 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" event={"ID":"b0b86a6b-0125-4a5b-bee2-8222a3698c3e","Type":"ContainerStarted","Data":"c9144f0c8bcd53c1cf070520b3c22f6fc7d4b96e6a40d8f01b76fc799176ccd4"} Jun 11 23:08:35.287745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.287707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:08:35.288186 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.287766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:08:35.290642 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.290617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:08:35.290761 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.290622 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:08:35.298935 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:35.298914 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:08:35.299046 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:35.299000 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:09:39.29897848 +0000 UTC m=+130.195444537 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : secret "metrics-daemon-secret" not found Jun 11 23:08:35.301666 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.301643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c80d7a-b6b4-4596-a631-ca2d9023a695-original-pull-secret\") pod \"global-pull-secret-syncer-v54pq\" (UID: \"21c80d7a-b6b4-4596-a631-ca2d9023a695\") " pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:08:35.389043 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.389007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:35.391823 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.391798 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:08:35.402193 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.402156 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:08:35.413004 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.412972 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czpw\" (UniqueName: \"kubernetes.io/projected/71cff971-145d-499a-9807-a51e8eadda63-kube-api-access-8czpw\") pod \"network-check-target-jmw2c\" (UID: \"71cff971-145d-499a-9807-a51e8eadda63\") " pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:35.581980 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.581903 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hzjk5\"" Jun 11 23:08:35.584971 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.584935 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v54pq" Jun 11 23:08:35.588372 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:35.588354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:36.296413 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:36.296373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:08:36.296898 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:36.296555 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:36.296898 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:08:36.296651 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:09:08.296627014 +0000 UTC m=+99.193093057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:08:37.118369 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.118339 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v54pq"] Jun 11 23:08:37.121906 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:08:37.121850 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c80d7a_b6b4_4596_a631_ca2d9023a695.slice/crio-bc65b83e9a3d07dabc0ef24ad19dc05515ee9887e4fd0c30d327e92d590122a2 WatchSource:0}: Error finding container bc65b83e9a3d07dabc0ef24ad19dc05515ee9887e4fd0c30d327e92d590122a2: Status 404 returned error can't find the container with id bc65b83e9a3d07dabc0ef24ad19dc05515ee9887e4fd0c30d327e92d590122a2 Jun 11 23:08:37.129226 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.129200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jmw2c"] Jun 11 23:08:37.134003 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:08:37.133975 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cff971_145d_499a_9807_a51e8eadda63.slice/crio-2187f3a9f414fd6b5f05df1a38e30b477da07cb7eb02903db1e40874ef69f539 WatchSource:0}: Error finding container 2187f3a9f414fd6b5f05df1a38e30b477da07cb7eb02903db1e40874ef69f539: Status 404 returned error can't find the container with id 2187f3a9f414fd6b5f05df1a38e30b477da07cb7eb02903db1e40874ef69f539 Jun 11 23:08:37.869238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.869197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jmw2c" event={"ID":"71cff971-145d-499a-9807-a51e8eadda63","Type":"ContainerStarted","Data":"2187f3a9f414fd6b5f05df1a38e30b477da07cb7eb02903db1e40874ef69f539"} Jun 11 23:08:37.871547 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.871518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" event={"ID":"90024595-1411-443b-af55-2870195919f0","Type":"ContainerStarted","Data":"fbee0717f41809490e743748c15585eec4c97eb908001924a58e3d2b8e4c0d27"} Jun 11 23:08:37.871686 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.871560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" event={"ID":"90024595-1411-443b-af55-2870195919f0","Type":"ContainerStarted","Data":"c45222be9c9c477a4db9067fb1c7568974f4dcee397ce781c9580308e250f0da"} Jun 11 23:08:37.871686 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.871573 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" event={"ID":"90024595-1411-443b-af55-2870195919f0","Type":"ContainerStarted","Data":"0f27c181e1d0e0e2ac5d891c49015cf1e760228ee3f356219626aff035251a3a"} Jun 11 23:08:37.873241 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.873215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" event={"ID":"b0b86a6b-0125-4a5b-bee2-8222a3698c3e","Type":"ContainerStarted","Data":"2a3aae416c8dc34f2d16f885fa5720145de90b83512c1e4f96ee7c4b14968ba1"} Jun 11 23:08:37.873369 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.873350 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:37.874314 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.874289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v54pq" event={"ID":"21c80d7a-b6b4-4596-a631-ca2d9023a695","Type":"ContainerStarted","Data":"bc65b83e9a3d07dabc0ef24ad19dc05515ee9887e4fd0c30d327e92d590122a2"} Jun 11 23:08:37.875289 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.875269 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:08:37.911403 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.911358 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" podStartSLOduration=1.7525893369999999 podStartE2EDuration="6.911338904s" totalImagesPullingTime="5.158749567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:37.893507493 +0000 UTC m=+68.789973558" watchObservedRunningTime="2026-06-11 23:08:37.911338904 +0000 UTC m=+68.807804951" Jun 11 23:08:37.911676 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:37.911650 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" podStartSLOduration=1.733459763 podStartE2EDuration="6.91164045s" totalImagesPullingTime="5.178180687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:37.910299932 +0000 UTC m=+68.806765998" watchObservedRunningTime="2026-06-11 23:08:37.91164045 +0000 UTC m=+68.808106513" Jun 11 23:08:40.885899 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:40.885862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jmw2c" event={"ID":"71cff971-145d-499a-9807-a51e8eadda63","Type":"ContainerStarted","Data":"ec1c4df74aabbca8192159f6633e86f1b912ce674dc7bc25113948fc6d02d172"} Jun 11 23:08:40.886343 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:40.886105 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:08:41.890617 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:41.890583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v54pq" event={"ID":"21c80d7a-b6b4-4596-a631-ca2d9023a695","Type":"ContainerStarted","Data":"c31b9375b3d9702646f1fbeacdab800d32bfedb94ca04f7d035240dd83ff3fc3"} Jun 11 23:08:41.913087 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:41.913031 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jmw2c" podStartSLOduration=70.096696714 podStartE2EDuration="1m12.913014368s" totalImagesPullingTime="2.816317654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:40.901515929 +0000 UTC m=+71.797981994" watchObservedRunningTime="2026-06-11 23:08:41.913014368 +0000 UTC m=+72.809480410" Jun 11 23:08:41.913255 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:08:41.913191 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v54pq" podStartSLOduration=68.365047606 podStartE2EDuration="1m12.913186379s" totalImagesPullingTime="4.548138773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:41.912525075 +0000 UTC m=+72.808991145" watchObservedRunningTime="2026-06-11 23:08:41.913186379 +0000 UTC m=+72.809652443" Jun 11 23:09:08.322747 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:09:08.322707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:09:08.323219 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:09:08.322868 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:09:08.323219 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:09:08.322939 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:10:12.322920305 +0000 UTC m=+163.219386349 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:09:11.893048 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:09:11.893018 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jmw2c" Jun 11 23:09:39.337874 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:09:39.337823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:09:39.338310 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:09:39.337985 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:09:39.338310 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:09:39.338051 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs podName:811ee76d-d3b7-4790-ab1d-e3cdde50e3b1 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:41.338035452 +0000 UTC m=+252.234501494 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs") pod "network-metrics-daemon-ggh42" (UID: "811ee76d-d3b7-4790-ab1d-e3cdde50e3b1") : secret "metrics-daemon-secret" not found Jun 11 23:10:07.448657 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:10:07.448612 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qgwfn" podUID="5d387853-ec92-498d-853f-afde2c823804" Jun 11 23:10:08.139005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:08.138977 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgwfn" Jun 11 23:10:08.590395 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:10:08.590298 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ggh42" podUID="811ee76d-d3b7-4790-ab1d-e3cdde50e3b1" Jun 11 23:10:12.369481 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:12.369419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:10:12.369890 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:10:12.369565 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:10:12.369890 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:10:12.369632 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls podName:5d387853-ec92-498d-853f-afde2c823804 nodeName:}" failed. No retries permitted until 2026-06-11 23:12:14.369614031 +0000 UTC m=+285.266080090 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls") pod "dns-default-qgwfn" (UID: "5d387853-ec92-498d-853f-afde2c823804") : secret "dns-default-metrics-tls" not found Jun 11 23:10:20.565807 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:20.565714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:10:37.219619 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:37.219587 2581 generic.go:356] "Generic (PLEG): container finished" podID="b0b86a6b-0125-4a5b-bee2-8222a3698c3e" containerID="2a3aae416c8dc34f2d16f885fa5720145de90b83512c1e4f96ee7c4b14968ba1" exitCode=1 Jun 11 23:10:37.220109 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:37.219646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" event={"ID":"b0b86a6b-0125-4a5b-bee2-8222a3698c3e","Type":"ContainerDied","Data":"2a3aae416c8dc34f2d16f885fa5720145de90b83512c1e4f96ee7c4b14968ba1"} Jun 11 23:10:37.220109 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:37.220018 2581 scope.go:117] "RemoveContainer" containerID="2a3aae416c8dc34f2d16f885fa5720145de90b83512c1e4f96ee7c4b14968ba1" Jun 11 23:10:37.873548 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:37.873501 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:10:38.228005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:38.227914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" event={"ID":"b0b86a6b-0125-4a5b-bee2-8222a3698c3e","Type":"ContainerStarted","Data":"509cb76c7ca4599d916343eea30f4c89923b9bf16ce493460ffc8e4490570188"} Jun 11 23:10:38.228501 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:38.228205 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:10:38.228835 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:10:38.228818 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68d8bf8f85-2ng8w" Jun 11 23:11:15.143140 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.143106 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9zjgz"] Jun 11 23:11:15.145900 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.145885 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.148364 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.148340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 23:11:15.148531 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.148387 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 23:11:15.149088 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.149070 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 23:11:15.149186 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.149071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-87kjf\"" Jun 11 23:11:15.149186 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.149071 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 23:11:15.159080 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.159059 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zjgz"] Jun 11 23:11:15.207157 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.207127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnkgg\" (UniqueName: \"kubernetes.io/projected/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-api-access-rnkgg\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.207338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.207188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.207338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.207224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/600e47e6-01e3-4622-b74c-0e759bcd09b6-crio-socket\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.207338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.207240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.207338 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.207257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/600e47e6-01e3-4622-b74c-0e759bcd09b6-data-volume\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.308142 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.308110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.308142 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.308145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/600e47e6-01e3-4622-b74c-0e759bcd09b6-crio-socket\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.308319 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.308163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.308319 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.308179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/600e47e6-01e3-4622-b74c-0e759bcd09b6-data-volume\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.308319 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.308220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnkgg\" (UniqueName: \"kubernetes.io/projected/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-api-access-rnkgg\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.308319 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.308258 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:15.308319 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.308265 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:15.308319 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.308256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/600e47e6-01e3-4622-b74c-0e759bcd09b6-crio-socket\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.308596 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.308324 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:15.808309298 +0000 UTC m=+226.704775344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : configmap "kube-rbac-proxy" not found Jun 11 23:11:15.308596 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.308340 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:15.80833408 +0000 UTC m=+226.704800122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:15.308596 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.308550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/600e47e6-01e3-4622-b74c-0e759bcd09b6-data-volume\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.316422 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.316401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnkgg\" (UniqueName: \"kubernetes.io/projected/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-api-access-rnkgg\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.811797 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.811762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.811986 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:15.811804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:15.811986 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.811906 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:15.811986 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.811914 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:15.811986 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.811963 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:16.811949589 +0000 UTC m=+227.708415630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : configmap "kube-rbac-proxy" not found Jun 11 23:11:15.811986 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:15.811976 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:16.811970038 +0000 UTC m=+227.708436079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:16.819477 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:16.819409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:16.819902 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:16.819493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:16.819902 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:16.819563 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:16.819902 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:16.819605 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:16.819902 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:16.819637 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:18.819621757 +0000 UTC m=+229.716087799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:16.819902 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:16.819666 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:18.819651921 +0000 UTC m=+229.716117963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : configmap "kube-rbac-proxy" not found Jun 11 23:11:17.731695 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:17.731670 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5lf6p_4d75fb5c-1713-4cfd-94bd-9fb67342173a/dns-node-resolver/0.log" Jun 11 23:11:18.833693 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:18.833650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:18.833693 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:18.833695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:18.834141 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:18.833794 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:18.834141 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:18.833803 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:18.834141 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:18.833861 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:22.833843583 +0000 UTC m=+233.730309626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : configmap "kube-rbac-proxy" not found Jun 11 23:11:18.834141 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:18.833878 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:22.83386955 +0000 UTC m=+233.730335595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:19.131094 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:19.131067 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-znj4l_eac0f764-298c-48eb-822e-f46def43a74a/node-ca/0.log" Jun 11 23:11:19.932968 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:19.932940 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tqw5b_1b172de2-3457-48e3-98e0-a01f44d0805e/serve-healthcheck-canary/0.log" Jun 11 23:11:21.696231 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:21.696181 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" podUID="90024595-1411-443b-af55-2870195919f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 23:11:22.861340 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:22.861305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:22.861340 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:22.861343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:22.861823 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:22.861470 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:22.861823 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:22.861472 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:22.861823 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:22.861539 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:30.861522466 +0000 UTC m=+241.757988509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : configmap "kube-rbac-proxy" not found Jun 11 23:11:22.861823 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:11:22.861554 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls podName:600e47e6-01e3-4622-b74c-0e759bcd09b6 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:30.861547993 +0000 UTC m=+241.758014035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjgz" (UID: "600e47e6-01e3-4622-b74c-0e759bcd09b6") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:30.924078 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:30.924033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:30.924078 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:30.924083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:30.924658 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:30.924639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600e47e6-01e3-4622-b74c-0e759bcd09b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:30.926398 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:30.926376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600e47e6-01e3-4622-b74c-0e759bcd09b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjgz\" (UID: \"600e47e6-01e3-4622-b74c-0e759bcd09b6\") " pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:31.057938 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:31.057898 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-87kjf\"" Jun 11 23:11:31.065136 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:31.065105 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zjgz" Jun 11 23:11:31.208643 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:31.208555 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zjgz"] Jun 11 23:11:31.214274 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:11:31.214250 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600e47e6_01e3_4622_b74c_0e759bcd09b6.slice/crio-67d98a6936d3b0cd9914886d9234aa922db04820f8d1efd6cda259cb9f9bd3d3 WatchSource:0}: Error finding container 67d98a6936d3b0cd9914886d9234aa922db04820f8d1efd6cda259cb9f9bd3d3: Status 404 returned error can't find the container with id 67d98a6936d3b0cd9914886d9234aa922db04820f8d1efd6cda259cb9f9bd3d3 Jun 11 23:11:31.375670 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:31.375636 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjgz" event={"ID":"600e47e6-01e3-4622-b74c-0e759bcd09b6","Type":"ContainerStarted","Data":"67d98a6936d3b0cd9914886d9234aa922db04820f8d1efd6cda259cb9f9bd3d3"} Jun 11 23:11:31.696859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:31.696810 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" podUID="90024595-1411-443b-af55-2870195919f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 23:11:35.390465 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:35.390426 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjgz" event={"ID":"600e47e6-01e3-4622-b74c-0e759bcd09b6","Type":"ContainerStarted","Data":"82e2da93db4244cb3312b80ffa1a13e9ee3d529643a6ab93143c7351b72ef777"} Jun 11 23:11:35.390827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:35.390502 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjgz" event={"ID":"600e47e6-01e3-4622-b74c-0e759bcd09b6","Type":"ContainerStarted","Data":"2357c51689a64c4bd596338b208e79a35c7c52f770e9da732ff500a2e5c8a945"} Jun 11 23:11:36.608888 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.608856 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76648b44c8-lhrx5"] Jun 11 23:11:36.612045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.612021 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.619373 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.619348 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 23:11:36.619704 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.619679 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 23:11:36.620485 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.620312 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 23:11:36.620485 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.620373 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bthtv\"" Jun 11 23:11:36.625800 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.625778 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 23:11:36.634615 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.634588 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76648b44c8-lhrx5"] Jun 11 23:11:36.767287 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-bound-sa-token\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.767516 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/350e9555-dca0-4c15-ae52-4845375929b5-trusted-ca\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.767516 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/350e9555-dca0-4c15-ae52-4845375929b5-ca-trust-extracted\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.767516 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/350e9555-dca0-4c15-ae52-4845375929b5-registry-certificates\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.767516 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/350e9555-dca0-4c15-ae52-4845375929b5-image-registry-private-configuration\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.767516 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-registry-tls\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.767516 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/350e9555-dca0-4c15-ae52-4845375929b5-installation-pull-secrets\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.767844 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.767534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-kube-api-access-kj5k4\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868311 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/350e9555-dca0-4c15-ae52-4845375929b5-registry-certificates\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868311 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/350e9555-dca0-4c15-ae52-4845375929b5-image-registry-private-configuration\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868311 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-registry-tls\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868618 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/350e9555-dca0-4c15-ae52-4845375929b5-installation-pull-secrets\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868618 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-kube-api-access-kj5k4\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868618 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-bound-sa-token\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868618 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/350e9555-dca0-4c15-ae52-4845375929b5-trusted-ca\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.868618 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/350e9555-dca0-4c15-ae52-4845375929b5-ca-trust-extracted\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.869022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.868996 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/350e9555-dca0-4c15-ae52-4845375929b5-ca-trust-extracted\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.869235 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.869184 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/350e9555-dca0-4c15-ae52-4845375929b5-registry-certificates\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.870035 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.870013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/350e9555-dca0-4c15-ae52-4845375929b5-trusted-ca\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.871333 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.871309 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/350e9555-dca0-4c15-ae52-4845375929b5-image-registry-private-configuration\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.871808 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.871772 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/350e9555-dca0-4c15-ae52-4845375929b5-installation-pull-secrets\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.871907 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.871877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-registry-tls\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.877000 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.876901 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-bound-sa-token\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.877670 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.877647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/350e9555-dca0-4c15-ae52-4845375929b5-kube-api-access-kj5k4\") pod \"image-registry-76648b44c8-lhrx5\" (UID: \"350e9555-dca0-4c15-ae52-4845375929b5\") " pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:36.923164 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:36.923125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:37.210919 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:37.210892 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76648b44c8-lhrx5"] Jun 11 23:11:37.213462 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:11:37.213424 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350e9555_dca0_4c15_ae52_4845375929b5.slice/crio-6537c1f805cc902bcbfec42a4de7bed501e1831323edcd8d51308f1196d4bab0 WatchSource:0}: Error finding container 6537c1f805cc902bcbfec42a4de7bed501e1831323edcd8d51308f1196d4bab0: Status 404 returned error can't find the container with id 6537c1f805cc902bcbfec42a4de7bed501e1831323edcd8d51308f1196d4bab0 Jun 11 23:11:37.398764 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:37.398673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjgz" event={"ID":"600e47e6-01e3-4622-b74c-0e759bcd09b6","Type":"ContainerStarted","Data":"1c7ec8d3d90046e8635299977708abd46370e6a9b6282dbb3ee014522757cbb8"} Jun 11 23:11:37.400242 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:37.400204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" event={"ID":"350e9555-dca0-4c15-ae52-4845375929b5","Type":"ContainerStarted","Data":"a9fa59e5a659e41f7adcf93294b380378938a55aca825ed0c6ca043f37d14a3e"} Jun 11 23:11:37.400386 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:37.400261 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:11:37.400386 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:37.400280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" event={"ID":"350e9555-dca0-4c15-ae52-4845375929b5","Type":"ContainerStarted","Data":"6537c1f805cc902bcbfec42a4de7bed501e1831323edcd8d51308f1196d4bab0"} Jun 11 23:11:37.420646 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:37.420599 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9zjgz" podStartSLOduration=16.620688241 podStartE2EDuration="22.420584147s" totalImagesPullingTime="5.799895906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:11:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:37.419994643 +0000 UTC m=+248.316460707" watchObservedRunningTime="2026-06-11 23:11:37.420584147 +0000 UTC m=+248.317050211" Jun 11 23:11:37.449218 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:37.449163 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podStartSLOduration=1.4491474389999999 podStartE2EDuration="1.449147439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:37.447805459 +0000 UTC m=+248.344271522" watchObservedRunningTime="2026-06-11 23:11:37.449147439 +0000 UTC m=+248.345613503" Jun 11 23:11:41.403620 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.403572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:11:41.406008 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.405986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/811ee76d-d3b7-4790-ab1d-e3cdde50e3b1-metrics-certs\") pod \"network-metrics-daemon-ggh42\" (UID: \"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1\") " pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:11:41.569431 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.569399 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nchnx\"" Jun 11 23:11:41.577647 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.577624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggh42" Jun 11 23:11:41.696761 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.696726 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" podUID="90024595-1411-443b-af55-2870195919f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 23:11:41.696909 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.696794 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" Jun 11 23:11:41.697250 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.697219 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"fbee0717f41809490e743748c15585eec4c97eb908001924a58e3d2b8e4c0d27"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 23:11:41.697304 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.697270 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" podUID="90024595-1411-443b-af55-2870195919f0" containerName="service-proxy" containerID="cri-o://fbee0717f41809490e743748c15585eec4c97eb908001924a58e3d2b8e4c0d27" gracePeriod=30 Jun 11 23:11:41.704081 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:41.704056 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggh42"] Jun 11 23:11:41.706952 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:11:41.706925 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811ee76d_d3b7_4790_ab1d_e3cdde50e3b1.slice/crio-4cdcb2639e35950b76b71ad4b63ca2bead9e2ad6c4c04c778690444db0568eac WatchSource:0}: Error finding container 4cdcb2639e35950b76b71ad4b63ca2bead9e2ad6c4c04c778690444db0568eac: Status 404 returned error can't find the container with id 4cdcb2639e35950b76b71ad4b63ca2bead9e2ad6c4c04c778690444db0568eac Jun 11 23:11:42.418259 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:42.418217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggh42" event={"ID":"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1","Type":"ContainerStarted","Data":"4cdcb2639e35950b76b71ad4b63ca2bead9e2ad6c4c04c778690444db0568eac"} Jun 11 23:11:42.420761 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:42.420727 2581 generic.go:356] "Generic (PLEG): container finished" podID="90024595-1411-443b-af55-2870195919f0" containerID="fbee0717f41809490e743748c15585eec4c97eb908001924a58e3d2b8e4c0d27" exitCode=2 Jun 11 23:11:42.420898 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:42.420774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" event={"ID":"90024595-1411-443b-af55-2870195919f0","Type":"ContainerDied","Data":"fbee0717f41809490e743748c15585eec4c97eb908001924a58e3d2b8e4c0d27"} Jun 11 23:11:42.420898 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:42.420820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d554bb445-fntqm" event={"ID":"90024595-1411-443b-af55-2870195919f0","Type":"ContainerStarted","Data":"6e2b10d76b3f06a2e2cf8c18af5ebd171cb7f509246d41bf5007283bb25d4185"} Jun 11 23:11:43.425969 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.425935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggh42" event={"ID":"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1","Type":"ContainerStarted","Data":"038d518fa734e7764ee641a4b77f2605a1b91208c267fc59e0e83e4142157180"} Jun 11 23:11:43.426361 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.425983 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggh42" event={"ID":"811ee76d-d3b7-4790-ab1d-e3cdde50e3b1","Type":"ContainerStarted","Data":"db92c595ba5db6d58b74f932064c52fdcc8ac62911ec8192db98c53fbe3ca6e4"} Jun 11 23:11:43.444734 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.444675 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ggh42" podStartSLOduration=253.649573582 podStartE2EDuration="4m14.444653292s" totalImagesPullingTime="795.07971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:43.443714012 +0000 UTC m=+254.340180075" watchObservedRunningTime="2026-06-11 23:11:43.444653292 +0000 UTC m=+254.341119356" Jun 11 23:11:43.849745 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.849660 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5glcz"] Jun 11 23:11:43.854027 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.854011 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:43.863890 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.863826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 23:11:43.863890 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.863870 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 23:11:43.864128 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.864112 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 23:11:43.864168 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.864121 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 23:11:43.864225 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.864210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 23:11:43.864811 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.864796 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 23:11:43.866022 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:43.866009 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ctfkv\"" Jun 11 23:11:44.021467 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021467 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021677 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-tls\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021677 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-wtmp\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021677 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6407658-2efe-4b2c-947b-afd92194696f-metrics-client-ca\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021677 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-root\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021803 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-sys\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021803 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-textfile\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.021803 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.021718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbgjd\" (UniqueName: \"kubernetes.io/projected/c6407658-2efe-4b2c-947b-afd92194696f-kube-api-access-nbgjd\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.122992 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.122962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.122999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-tls\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-wtmp\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6407658-2efe-4b2c-947b-afd92194696f-metrics-client-ca\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-root\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-sys\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-textfile\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbgjd\" (UniqueName: \"kubernetes.io/projected/c6407658-2efe-4b2c-947b-afd92194696f-kube-api-access-nbgjd\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123246 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-wtmp\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-sys\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123430 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6407658-2efe-4b2c-947b-afd92194696f-root\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123713 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123692 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-textfile\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.123771 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.123759 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.124201 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.124180 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6407658-2efe-4b2c-947b-afd92194696f-metrics-client-ca\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.125586 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.125561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.125906 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.125891 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6407658-2efe-4b2c-947b-afd92194696f-node-exporter-tls\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.133530 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.133508 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbgjd\" (UniqueName: \"kubernetes.io/projected/c6407658-2efe-4b2c-947b-afd92194696f-kube-api-access-nbgjd\") pod \"node-exporter-5glcz\" (UID: \"c6407658-2efe-4b2c-947b-afd92194696f\") " pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.162717 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.162683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5glcz" Jun 11 23:11:44.172953 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:11:44.172924 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6407658_2efe_4b2c_947b_afd92194696f.slice/crio-546284b9296c76ef5a7d62aa75353bf05cc881f37cc49b8dd79e5b80b81543de WatchSource:0}: Error finding container 546284b9296c76ef5a7d62aa75353bf05cc881f37cc49b8dd79e5b80b81543de: Status 404 returned error can't find the container with id 546284b9296c76ef5a7d62aa75353bf05cc881f37cc49b8dd79e5b80b81543de Jun 11 23:11:44.430803 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:44.430712 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5glcz" event={"ID":"c6407658-2efe-4b2c-947b-afd92194696f","Type":"ContainerStarted","Data":"546284b9296c76ef5a7d62aa75353bf05cc881f37cc49b8dd79e5b80b81543de"} Jun 11 23:11:45.435228 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:45.435191 2581 generic.go:356] "Generic (PLEG): container finished" podID="c6407658-2efe-4b2c-947b-afd92194696f" containerID="0134bb1ebcf90644710a68c69c3cb02c79c9d491d9761230f3c244f06b1fd519" exitCode=0 Jun 11 23:11:45.435666 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:45.435235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5glcz" event={"ID":"c6407658-2efe-4b2c-947b-afd92194696f","Type":"ContainerDied","Data":"0134bb1ebcf90644710a68c69c3cb02c79c9d491d9761230f3c244f06b1fd519"} Jun 11 23:11:46.440322 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:46.440290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5glcz" event={"ID":"c6407658-2efe-4b2c-947b-afd92194696f","Type":"ContainerStarted","Data":"c71b33eb5d3076765ca387fc7b3fe68aac0c343c6ec1b67f9e5a3899f9615067"} Jun 11 23:11:46.440821 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:46.440339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5glcz" event={"ID":"c6407658-2efe-4b2c-947b-afd92194696f","Type":"ContainerStarted","Data":"5443ae41f1c383d14cdcc4f971a70b84ef730d7099fbaac8ffb6c0356d7ffea1"} Jun 11 23:11:46.467301 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:46.467253 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5glcz" podStartSLOduration=2.595920828 podStartE2EDuration="3.467237313s" totalImagesPullingTime="802.158205ms" totalInitContainerRuntime="69.15828ms" isStatefulPod=true podCreationTimestamp="2026-06-11 23:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:46.465929271 +0000 UTC m=+257.362395336" watchObservedRunningTime="2026-06-11 23:11:46.467237313 +0000 UTC m=+257.363703377" Jun 11 23:11:56.927857 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:56.927814 2581 patch_prober.go:28] interesting pod/image-registry-76648b44c8-lhrx5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:11:56.928313 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:56.927872 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podUID="350e9555-dca0-4c15-ae52-4845375929b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:11:58.408210 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:58.408174 2581 patch_prober.go:28] interesting pod/image-registry-76648b44c8-lhrx5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:11:58.408665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:11:58.408230 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podUID="350e9555-dca0-4c15-ae52-4845375929b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:12:06.928061 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:06.928027 2581 patch_prober.go:28] interesting pod/image-registry-76648b44c8-lhrx5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:12:06.928473 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:06.928078 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podUID="350e9555-dca0-4c15-ae52-4845375929b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:12:08.408104 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:08.408068 2581 patch_prober.go:28] interesting pod/image-registry-76648b44c8-lhrx5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:12:08.408493 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:08.408121 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podUID="350e9555-dca0-4c15-ae52-4845375929b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:12:11.139733 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:12:11.139681 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qgwfn" podUID="5d387853-ec92-498d-853f-afde2c823804" Jun 11 23:12:11.515237 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:11.515156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgwfn" Jun 11 23:12:14.439859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:14.439821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:12:14.442276 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:14.442255 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d387853-ec92-498d-853f-afde2c823804-metrics-tls\") pod \"dns-default-qgwfn\" (UID: \"5d387853-ec92-498d-853f-afde2c823804\") " pod="openshift-dns/dns-default-qgwfn" Jun 11 23:12:14.518919 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:14.518890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p6jbq\"" Jun 11 23:12:14.526874 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:14.526852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgwfn" Jun 11 23:12:14.651005 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:14.650974 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgwfn"] Jun 11 23:12:14.653748 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:12:14.653723 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d387853_ec92_498d_853f_afde2c823804.slice/crio-f972a98e20b1fd8658968c730a74e16e53bc9ad09281e62606c83de987589e01 WatchSource:0}: Error finding container f972a98e20b1fd8658968c730a74e16e53bc9ad09281e62606c83de987589e01: Status 404 returned error can't find the container with id f972a98e20b1fd8658968c730a74e16e53bc9ad09281e62606c83de987589e01 Jun 11 23:12:15.529544 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:15.529506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgwfn" event={"ID":"5d387853-ec92-498d-853f-afde2c823804","Type":"ContainerStarted","Data":"f972a98e20b1fd8658968c730a74e16e53bc9ad09281e62606c83de987589e01"} Jun 11 23:12:16.534689 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.534587 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgwfn" event={"ID":"5d387853-ec92-498d-853f-afde2c823804","Type":"ContainerStarted","Data":"d54034493f08e295bc0fba274c37151c5bff31eeb8307d8abb14e81ff40a2272"} Jun 11 23:12:16.534689 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.534649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgwfn" event={"ID":"5d387853-ec92-498d-853f-afde2c823804","Type":"ContainerStarted","Data":"3cb3c2f19bfbb48b3931bd0e4142aa6060f4ec651df3fe4e6f43c200d0e73e53"} Jun 11 23:12:16.534689 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.534675 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qgwfn" Jun 11 23:12:16.552504 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.552432 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qgwfn" podStartSLOduration=251.079525185 podStartE2EDuration="4m12.552415351s" totalImagesPullingTime="1.472890166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:16.551057533 +0000 UTC m=+287.447523597" watchObservedRunningTime="2026-06-11 23:12:16.552415351 +0000 UTC m=+287.448881415" Jun 11 23:12:16.928017 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.927984 2581 patch_prober.go:28] interesting pod/image-registry-76648b44c8-lhrx5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:12:16.928195 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.928037 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podUID="350e9555-dca0-4c15-ae52-4845375929b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:12:16.928195 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.928073 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:12:16.928524 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.928503 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"a9fa59e5a659e41f7adcf93294b380378938a55aca825ed0c6ca043f37d14a3e"} pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 23:12:16.931999 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.931977 2581 patch_prober.go:28] interesting pod/image-registry-76648b44c8-lhrx5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:12:16.932108 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:16.932014 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podUID="350e9555-dca0-4c15-ae52-4845375929b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:12:26.541305 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:26.541272 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qgwfn" Jun 11 23:12:26.932998 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:26.932968 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:12:29.512342 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:29.512316 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:12:29.513374 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:29.513357 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:12:29.519713 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:29.515858 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 23:12:41.948469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:41.948397 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" podUID="350e9555-dca0-4c15-ae52-4845375929b5" containerName="registry" containerID="cri-o://a9fa59e5a659e41f7adcf93294b380378938a55aca825ed0c6ca043f37d14a3e" gracePeriod=30 Jun 11 23:12:43.623357 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:43.623319 2581 generic.go:356] "Generic (PLEG): container finished" podID="350e9555-dca0-4c15-ae52-4845375929b5" containerID="a9fa59e5a659e41f7adcf93294b380378938a55aca825ed0c6ca043f37d14a3e" exitCode=0 Jun 11 23:12:43.623865 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:43.623366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" event={"ID":"350e9555-dca0-4c15-ae52-4845375929b5","Type":"ContainerDied","Data":"a9fa59e5a659e41f7adcf93294b380378938a55aca825ed0c6ca043f37d14a3e"} Jun 11 23:12:43.623865 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:43.623410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" event={"ID":"350e9555-dca0-4c15-ae52-4845375929b5","Type":"ContainerStarted","Data":"ecd023dc1532d5b10e05bceb45a3e38bf05390d63fd5a001fb5e6fc534a2b364"} Jun 11 23:12:43.623865 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:43.623505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:12:45.492732 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:45.492681 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76648b44c8-lhrx5_350e9555-dca0-4c15-ae52-4845375929b5/registry/0.log" Jun 11 23:12:45.497979 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:45.497962 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76648b44c8-lhrx5_350e9555-dca0-4c15-ae52-4845375929b5/registry/1.log" Jun 11 23:12:46.080472 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:46.080425 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-znj4l_eac0f764-298c-48eb-822e-f46def43a74a/node-ca/0.log" Jun 11 23:12:46.881286 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:12:46.881256 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tqw5b_1b172de2-3457-48e3-98e0-a01f44d0805e/serve-healthcheck-canary/0.log" Jun 11 23:13:04.631737 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:13:04.631709 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76648b44c8-lhrx5" Jun 11 23:15:29.838627 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.838591 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d"] Jun 11 23:15:29.841701 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.841685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:29.844211 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.844188 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:15:29.844332 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.844270 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vw86s\"" Jun 11 23:15:29.844332 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.844270 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 23:15:29.854753 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.854731 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d"] Jun 11 23:15:29.983839 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.983800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a96e332-3647-4c9a-9b19-70fb05290032-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sqc7d\" (UID: \"5a96e332-3647-4c9a-9b19-70fb05290032\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:29.984016 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:29.983851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzhgz\" (UniqueName: \"kubernetes.io/projected/5a96e332-3647-4c9a-9b19-70fb05290032-kube-api-access-xzhgz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sqc7d\" (UID: \"5a96e332-3647-4c9a-9b19-70fb05290032\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:30.084224 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:30.084186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzhgz\" (UniqueName: \"kubernetes.io/projected/5a96e332-3647-4c9a-9b19-70fb05290032-kube-api-access-xzhgz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sqc7d\" (UID: \"5a96e332-3647-4c9a-9b19-70fb05290032\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:30.084380 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:30.084245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a96e332-3647-4c9a-9b19-70fb05290032-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sqc7d\" (UID: \"5a96e332-3647-4c9a-9b19-70fb05290032\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:30.084626 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:30.084608 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a96e332-3647-4c9a-9b19-70fb05290032-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sqc7d\" (UID: \"5a96e332-3647-4c9a-9b19-70fb05290032\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:30.095033 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:30.094969 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzhgz\" (UniqueName: \"kubernetes.io/projected/5a96e332-3647-4c9a-9b19-70fb05290032-kube-api-access-xzhgz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sqc7d\" (UID: \"5a96e332-3647-4c9a-9b19-70fb05290032\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:30.150971 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:30.150939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" Jun 11 23:15:30.281701 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:30.281587 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d"] Jun 11 23:15:30.284426 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:15:30.284395 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a96e332_3647_4c9a_9b19_70fb05290032.slice/crio-767387c6bf5ab6508dc49d9d9a83f8c3138fbd499bb2b00f466440b21a30cd58 WatchSource:0}: Error finding container 767387c6bf5ab6508dc49d9d9a83f8c3138fbd499bb2b00f466440b21a30cd58: Status 404 returned error can't find the container with id 767387c6bf5ab6508dc49d9d9a83f8c3138fbd499bb2b00f466440b21a30cd58 Jun 11 23:15:30.286882 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:30.286865 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:15:31.177967 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:31.177929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" event={"ID":"5a96e332-3647-4c9a-9b19-70fb05290032","Type":"ContainerStarted","Data":"767387c6bf5ab6508dc49d9d9a83f8c3138fbd499bb2b00f466440b21a30cd58"} Jun 11 23:15:33.187049 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:33.187014 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" event={"ID":"5a96e332-3647-4c9a-9b19-70fb05290032","Type":"ContainerStarted","Data":"b83ff0e75e547ce778d6fcf30414feea8fed32ec62e06d1357b8482eeaaa6abc"} Jun 11 23:15:33.211488 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:15:33.211417 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sqc7d" podStartSLOduration=2.081567488 podStartE2EDuration="4.211389328s" totalImagesPullingTime="2.12982184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:15:33.209439313 +0000 UTC m=+484.105905376" watchObservedRunningTime="2026-06-11 23:15:33.211389328 +0000 UTC m=+484.107855392" Jun 11 23:16:20.833360 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.833283 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756"] Jun 11 23:16:20.836085 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.836070 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:20.839659 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.839633 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 23:16:20.839785 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.839664 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 23:16:20.839785 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.839707 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 23:16:20.839785 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.839761 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 23:16:20.839987 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.839899 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dvq77\"" Jun 11 23:16:20.839987 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.839967 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:16:20.847843 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.847820 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756"] Jun 11 23:16:20.934039 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.934006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0527d32f-aaaa-4080-b33c-3d43886199dd-manager-config\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:20.934227 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.934061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4wk8\" (UniqueName: \"kubernetes.io/projected/0527d32f-aaaa-4080-b33c-3d43886199dd-kube-api-access-q4wk8\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:20.934227 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.934083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0527d32f-aaaa-4080-b33c-3d43886199dd-metrics-cert\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:20.934227 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:20.934107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0527d32f-aaaa-4080-b33c-3d43886199dd-cert\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.035493 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.035427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4wk8\" (UniqueName: \"kubernetes.io/projected/0527d32f-aaaa-4080-b33c-3d43886199dd-kube-api-access-q4wk8\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.035678 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.035502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0527d32f-aaaa-4080-b33c-3d43886199dd-metrics-cert\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.035678 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.035535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0527d32f-aaaa-4080-b33c-3d43886199dd-cert\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.035678 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.035586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0527d32f-aaaa-4080-b33c-3d43886199dd-manager-config\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.036215 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.036191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0527d32f-aaaa-4080-b33c-3d43886199dd-manager-config\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.038054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.038019 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0527d32f-aaaa-4080-b33c-3d43886199dd-metrics-cert\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.038153 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.038079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0527d32f-aaaa-4080-b33c-3d43886199dd-cert\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.043800 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.043779 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4wk8\" (UniqueName: \"kubernetes.io/projected/0527d32f-aaaa-4080-b33c-3d43886199dd-kube-api-access-q4wk8\") pod \"lws-controller-manager-d6c54dcf4-gn756\" (UID: \"0527d32f-aaaa-4080-b33c-3d43886199dd\") " pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.145219 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.145184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:21.271669 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.271632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756"] Jun 11 23:16:21.274617 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:16:21.274583 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0527d32f_aaaa_4080_b33c_3d43886199dd.slice/crio-d9f82d6a7be99447d122e7e1607f09c9be0525a340fc5abd9fe2f555cd1fbf6b WatchSource:0}: Error finding container d9f82d6a7be99447d122e7e1607f09c9be0525a340fc5abd9fe2f555cd1fbf6b: Status 404 returned error can't find the container with id d9f82d6a7be99447d122e7e1607f09c9be0525a340fc5abd9fe2f555cd1fbf6b Jun 11 23:16:21.347563 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:21.347531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" event={"ID":"0527d32f-aaaa-4080-b33c-3d43886199dd","Type":"ContainerStarted","Data":"d9f82d6a7be99447d122e7e1607f09c9be0525a340fc5abd9fe2f555cd1fbf6b"} Jun 11 23:16:23.714862 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.714822 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9"] Jun 11 23:16:23.718089 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.718067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.721068 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.721045 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:16:23.721933 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.721581 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:16:23.721933 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.721645 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t7sdg\"" Jun 11 23:16:23.721933 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.721757 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:16:23.726151 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.726062 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:16:23.738322 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.738271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9"] Jun 11 23:16:23.758272 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.758244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2d4e09-b88f-4652-b24a-c421dc023209-tmp\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.758392 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.758277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2df\" (UniqueName: \"kubernetes.io/projected/6a2d4e09-b88f-4652-b24a-c421dc023209-kube-api-access-pq2df\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.758392 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.758315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2d4e09-b88f-4652-b24a-c421dc023209-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.758508 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.758394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2d4e09-b88f-4652-b24a-c421dc023209-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.758508 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.758438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2d4e09-b88f-4652-b24a-c421dc023209-manifests\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.859139 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.859103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2d4e09-b88f-4652-b24a-c421dc023209-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.859139 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.859141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2d4e09-b88f-4652-b24a-c421dc023209-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.859387 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.859172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2d4e09-b88f-4652-b24a-c421dc023209-manifests\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.859387 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.859202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2d4e09-b88f-4652-b24a-c421dc023209-tmp\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.859387 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.859232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2df\" (UniqueName: \"kubernetes.io/projected/6a2d4e09-b88f-4652-b24a-c421dc023209-kube-api-access-pq2df\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.859615 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.859588 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2d4e09-b88f-4652-b24a-c421dc023209-manifests\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.861996 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.861968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2d4e09-b88f-4652-b24a-c421dc023209-tmp\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.862109 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.862074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2d4e09-b88f-4652-b24a-c421dc023209-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.862288 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.862268 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2d4e09-b88f-4652-b24a-c421dc023209-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:23.869172 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:23.869149 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2df\" (UniqueName: \"kubernetes.io/projected/6a2d4e09-b88f-4652-b24a-c421dc023209-kube-api-access-pq2df\") pod \"opendatahub-operator-controller-manager-78f979bd8b-j4gg9\" (UID: \"6a2d4e09-b88f-4652-b24a-c421dc023209\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:24.030852 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:24.030747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:24.163554 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:24.163529 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9"] Jun 11 23:16:24.166074 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:16:24.166046 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2d4e09_b88f_4652_b24a_c421dc023209.slice/crio-1556ead619c8245c2e8ebd6b0bafed329a9aa6ec87f927ca9027f206f55cad93 WatchSource:0}: Error finding container 1556ead619c8245c2e8ebd6b0bafed329a9aa6ec87f927ca9027f206f55cad93: Status 404 returned error can't find the container with id 1556ead619c8245c2e8ebd6b0bafed329a9aa6ec87f927ca9027f206f55cad93 Jun 11 23:16:24.359844 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:24.359805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" event={"ID":"6a2d4e09-b88f-4652-b24a-c421dc023209","Type":"ContainerStarted","Data":"1556ead619c8245c2e8ebd6b0bafed329a9aa6ec87f927ca9027f206f55cad93"} Jun 11 23:16:24.361167 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:24.361144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" event={"ID":"0527d32f-aaaa-4080-b33c-3d43886199dd","Type":"ContainerStarted","Data":"e483b704d1c8eba3b69394b60466c3dc87b59c1f4c9900eacd9391be6195da99"} Jun 11 23:16:24.361304 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:24.361271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:24.378225 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:24.378179 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" podStartSLOduration=2.094480401 podStartE2EDuration="4.37816547s" totalImagesPullingTime="2.283685069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:24.377000734 +0000 UTC m=+535.273466797" watchObservedRunningTime="2026-06-11 23:16:24.37816547 +0000 UTC m=+535.274631534" Jun 11 23:16:27.375152 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:27.375115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" event={"ID":"6a2d4e09-b88f-4652-b24a-c421dc023209","Type":"ContainerStarted","Data":"7c6e647e941f92cf3f2c9fd6f103fdad79208a61ac7a37e490bd6cc627f51d25"} Jun 11 23:16:28.380615 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:28.380577 2581 generic.go:356] "Generic (PLEG): container finished" podID="6a2d4e09-b88f-4652-b24a-c421dc023209" containerID="7c6e647e941f92cf3f2c9fd6f103fdad79208a61ac7a37e490bd6cc627f51d25" exitCode=0 Jun 11 23:16:28.380615 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:28.380617 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" event={"ID":"6a2d4e09-b88f-4652-b24a-c421dc023209","Type":"ContainerDied","Data":"7c6e647e941f92cf3f2c9fd6f103fdad79208a61ac7a37e490bd6cc627f51d25"} Jun 11 23:16:29.386304 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:29.386272 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" event={"ID":"6a2d4e09-b88f-4652-b24a-c421dc023209","Type":"ContainerStarted","Data":"0b69685d0a586ff0f7335a097cabada7214b1771faa86b52f2aaee866afb2827"} Jun 11 23:16:29.386814 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:29.386398 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:16:29.413020 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:29.412954 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" podStartSLOduration=2.453280714 podStartE2EDuration="6.41293297s" totalImagesPullingTime="2.973519173s" totalInitContainerRuntime="986.133083ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:29.412041978 +0000 UTC m=+540.308508042" watchObservedRunningTime="2026-06-11 23:16:29.41293297 +0000 UTC m=+540.309399035" Jun 11 23:16:35.369000 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:35.368963 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d6c54dcf4-gn756" Jun 11 23:16:40.392731 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:16:40.392698 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-j4gg9" Jun 11 23:17:14.480068 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.480035 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-dd6984748-fcczv"] Jun 11 23:17:14.484356 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.484337 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.487039 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.487016 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 23:17:14.487139 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.487090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jbmjf\"" Jun 11 23:17:14.490812 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.490787 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dd6984748-fcczv"] Jun 11 23:17:14.541792 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.541759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hmg\" (UniqueName: \"kubernetes.io/projected/40f97bb5-2157-4d1b-8180-7d52c120bc11-kube-api-access-g2hmg\") pod \"dashboard-redirect-dd6984748-fcczv\" (UID: \"40f97bb5-2157-4d1b-8180-7d52c120bc11\") " pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.541947 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.541812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/40f97bb5-2157-4d1b-8180-7d52c120bc11-redirect-config\") pod \"dashboard-redirect-dd6984748-fcczv\" (UID: \"40f97bb5-2157-4d1b-8180-7d52c120bc11\") " pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.642806 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.642776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/40f97bb5-2157-4d1b-8180-7d52c120bc11-redirect-config\") pod \"dashboard-redirect-dd6984748-fcczv\" (UID: \"40f97bb5-2157-4d1b-8180-7d52c120bc11\") " pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.642998 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.642872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hmg\" (UniqueName: \"kubernetes.io/projected/40f97bb5-2157-4d1b-8180-7d52c120bc11-kube-api-access-g2hmg\") pod \"dashboard-redirect-dd6984748-fcczv\" (UID: \"40f97bb5-2157-4d1b-8180-7d52c120bc11\") " pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.643537 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.643519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/40f97bb5-2157-4d1b-8180-7d52c120bc11-redirect-config\") pod \"dashboard-redirect-dd6984748-fcczv\" (UID: \"40f97bb5-2157-4d1b-8180-7d52c120bc11\") " pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.650869 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.650850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hmg\" (UniqueName: \"kubernetes.io/projected/40f97bb5-2157-4d1b-8180-7d52c120bc11-kube-api-access-g2hmg\") pod \"dashboard-redirect-dd6984748-fcczv\" (UID: \"40f97bb5-2157-4d1b-8180-7d52c120bc11\") " pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.795892 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.795796 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dd6984748-fcczv" Jun 11 23:17:14.923231 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:14.923203 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dd6984748-fcczv"] Jun 11 23:17:14.925760 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:17:14.925732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f97bb5_2157_4d1b_8180_7d52c120bc11.slice/crio-293eaff21088fd95392123e470ec3de259db76948b5b6d757fe0c0cf4717dd40 WatchSource:0}: Error finding container 293eaff21088fd95392123e470ec3de259db76948b5b6d757fe0c0cf4717dd40: Status 404 returned error can't find the container with id 293eaff21088fd95392123e470ec3de259db76948b5b6d757fe0c0cf4717dd40 Jun 11 23:17:15.571503 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:15.571436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dd6984748-fcczv" event={"ID":"40f97bb5-2157-4d1b-8180-7d52c120bc11","Type":"ContainerStarted","Data":"293eaff21088fd95392123e470ec3de259db76948b5b6d757fe0c0cf4717dd40"} Jun 11 23:17:17.573942 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:17.573899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dd6984748-fcczv" event={"ID":"40f97bb5-2157-4d1b-8180-7d52c120bc11","Type":"ContainerStarted","Data":"ba9ecd6ff0a57368715c209292e1a77ac15b1258251d1e2c1472d19cc3ad2cab"} Jun 11 23:17:17.590598 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:17.590549 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-dd6984748-fcczv" podStartSLOduration=1.89568249 podStartE2EDuration="3.590535013s" totalImagesPullingTime="1.694852523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:17.589945108 +0000 UTC m=+588.486411171" watchObservedRunningTime="2026-06-11 23:17:17.590535013 +0000 UTC m=+588.487001076" Jun 11 23:17:29.535840 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:29.535811 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:17:29.536306 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:29.535991 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:17:36.551469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.551425 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv"] Jun 11 23:17:36.563182 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.563159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.566133 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.566102 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv"] Jun 11 23:17:36.566272 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.566201 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 23:17:36.566272 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.566129 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:17:36.566403 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.566160 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 23:17:36.567192 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.567173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sj2jh\"" Jun 11 23:17:36.604962 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.604938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605095 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.604966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af8320c-7b33-4512-bbee-21cd66191f9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605095 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.604988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605095 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.605044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605095 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.605070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/1af8320c-7b33-4512-bbee-21cd66191f9d-kube-api-access-4cgps\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605095 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.605091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605283 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.605111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605283 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.605137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.605283 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.605156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705690 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705690 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af8320c-7b33-4512-bbee-21cd66191f9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/1af8320c-7b33-4512-bbee-21cd66191f9d-kube-api-access-4cgps\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.705923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.705919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.706181 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.706148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.706288 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.706250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.706426 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.706397 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.706521 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.706394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.706906 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.706883 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af8320c-7b33-4512-bbee-21cd66191f9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.708311 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.708291 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.708443 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.708426 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.716962 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.716943 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af8320c-7b33-4512-bbee-21cd66191f9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.717892 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.717871 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/1af8320c-7b33-4512-bbee-21cd66191f9d-kube-api-access-4cgps\") pod \"data-science-gateway-data-science-gateway-class-74759f9795vd5mv\" (UID: \"1af8320c-7b33-4512-bbee-21cd66191f9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:36.873695 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:36.873662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:37.013536 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:37.011533 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv"] Jun 11 23:17:37.017580 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:17:37.017553 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af8320c_7b33_4512_bbee_21cd66191f9d.slice/crio-c07f4246bc58f10f4a641185666d606919c52a78b0756e502ad8f34ad838229f WatchSource:0}: Error finding container c07f4246bc58f10f4a641185666d606919c52a78b0756e502ad8f34ad838229f: Status 404 returned error can't find the container with id c07f4246bc58f10f4a641185666d606919c52a78b0756e502ad8f34ad838229f Jun 11 23:17:37.648643 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:37.648590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" event={"ID":"1af8320c-7b33-4512-bbee-21cd66191f9d","Type":"ContainerStarted","Data":"c07f4246bc58f10f4a641185666d606919c52a78b0756e502ad8f34ad838229f"} Jun 11 23:17:39.711997 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:39.711961 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:17:39.712240 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:39.712033 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:17:39.712240 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:39.712061 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:17:40.661646 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:40.661604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" event={"ID":"1af8320c-7b33-4512-bbee-21cd66191f9d","Type":"ContainerStarted","Data":"f38b294e193146a5290589e9799860a146d12c592df9b44b929d3626934b6eb4"} Jun 11 23:17:40.682320 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:40.682265 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" podStartSLOduration=1.9900478590000001 podStartE2EDuration="4.68224897s" totalImagesPullingTime="2.692201111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:40.681149392 +0000 UTC m=+611.577615456" watchObservedRunningTime="2026-06-11 23:17:40.68224897 +0000 UTC m=+611.578715117" Jun 11 23:17:40.874331 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:40.874301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:40.878815 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:40.878789 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:41.665530 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:41.665502 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:41.666542 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:41.666507 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795vd5mv" Jun 11 23:17:45.296066 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.295988 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9px7k"] Jun 11 23:17:45.299403 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.299384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" Jun 11 23:17:45.301802 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.301782 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:17:45.302862 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.302840 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xl95z\"" Jun 11 23:17:45.302988 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.302854 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:17:45.311835 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.311812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9px7k"] Jun 11 23:17:45.378139 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.378106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jq4b\" (UniqueName: \"kubernetes.io/projected/96109df4-f969-48fc-9180-e89914e7b12a-kube-api-access-6jq4b\") pod \"kuadrant-operator-catalog-9px7k\" (UID: \"96109df4-f969-48fc-9180-e89914e7b12a\") " pod="kuadrant-system/kuadrant-operator-catalog-9px7k" Jun 11 23:17:45.478539 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.478503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jq4b\" (UniqueName: \"kubernetes.io/projected/96109df4-f969-48fc-9180-e89914e7b12a-kube-api-access-6jq4b\") pod \"kuadrant-operator-catalog-9px7k\" (UID: \"96109df4-f969-48fc-9180-e89914e7b12a\") " pod="kuadrant-system/kuadrant-operator-catalog-9px7k" Jun 11 23:17:45.486828 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.486790 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jq4b\" (UniqueName: \"kubernetes.io/projected/96109df4-f969-48fc-9180-e89914e7b12a-kube-api-access-6jq4b\") pod \"kuadrant-operator-catalog-9px7k\" (UID: \"96109df4-f969-48fc-9180-e89914e7b12a\") " pod="kuadrant-system/kuadrant-operator-catalog-9px7k" Jun 11 23:17:45.609046 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.609013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" Jun 11 23:17:45.740485 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.740392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9px7k"] Jun 11 23:17:45.742797 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:17:45.742768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96109df4_f969_48fc_9180_e89914e7b12a.slice/crio-40fe99fdfac7c658d198045eaef82429568f97c4e4d600c99d9b8725f4a5f0f7 WatchSource:0}: Error finding container 40fe99fdfac7c658d198045eaef82429568f97c4e4d600c99d9b8725f4a5f0f7: Status 404 returned error can't find the container with id 40fe99fdfac7c658d198045eaef82429568f97c4e4d600c99d9b8725f4a5f0f7 Jun 11 23:17:45.763863 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.763834 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9px7k"] Jun 11 23:17:45.872696 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.872615 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xldgq"] Jun 11 23:17:45.876885 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.876864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:45.883486 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.883440 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xldgq"] Jun 11 23:17:45.982236 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:45.982205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5gq4\" (UniqueName: \"kubernetes.io/projected/97848d8c-16d6-43f6-ba98-a37deb042393-kube-api-access-w5gq4\") pod \"kuadrant-operator-catalog-xldgq\" (UID: \"97848d8c-16d6-43f6-ba98-a37deb042393\") " pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:46.083222 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:46.083187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5gq4\" (UniqueName: \"kubernetes.io/projected/97848d8c-16d6-43f6-ba98-a37deb042393-kube-api-access-w5gq4\") pod \"kuadrant-operator-catalog-xldgq\" (UID: \"97848d8c-16d6-43f6-ba98-a37deb042393\") " pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:46.092070 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:46.092035 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5gq4\" (UniqueName: \"kubernetes.io/projected/97848d8c-16d6-43f6-ba98-a37deb042393-kube-api-access-w5gq4\") pod \"kuadrant-operator-catalog-xldgq\" (UID: \"97848d8c-16d6-43f6-ba98-a37deb042393\") " pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:46.186911 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:46.186840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:46.352491 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:46.352462 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xldgq"] Jun 11 23:17:46.414820 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:17:46.414787 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97848d8c_16d6_43f6_ba98_a37deb042393.slice/crio-b96101fafb69069623ae68106b6a93a6cdf7443ace9ece239e9c123cc2829a64 WatchSource:0}: Error finding container b96101fafb69069623ae68106b6a93a6cdf7443ace9ece239e9c123cc2829a64: Status 404 returned error can't find the container with id b96101fafb69069623ae68106b6a93a6cdf7443ace9ece239e9c123cc2829a64 Jun 11 23:17:46.688173 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:46.688106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" event={"ID":"97848d8c-16d6-43f6-ba98-a37deb042393","Type":"ContainerStarted","Data":"b96101fafb69069623ae68106b6a93a6cdf7443ace9ece239e9c123cc2829a64"} Jun 11 23:17:46.689756 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:46.689700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" event={"ID":"96109df4-f969-48fc-9180-e89914e7b12a","Type":"ContainerStarted","Data":"40fe99fdfac7c658d198045eaef82429568f97c4e4d600c99d9b8725f4a5f0f7"} Jun 11 23:17:47.695524 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:47.695489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" event={"ID":"96109df4-f969-48fc-9180-e89914e7b12a","Type":"ContainerStarted","Data":"ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93"} Jun 11 23:17:47.695954 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:47.695537 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" podUID="96109df4-f969-48fc-9180-e89914e7b12a" containerName="registry-server" containerID="cri-o://ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93" gracePeriod=2 Jun 11 23:17:47.696984 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:47.696957 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" event={"ID":"97848d8c-16d6-43f6-ba98-a37deb042393","Type":"ContainerStarted","Data":"e595a4f3e14e426c28a8ced7f7ad668b0dc989d9450e059f744b55ff62ba086f"} Jun 11 23:17:47.709495 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:47.709428 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" podStartSLOduration=0.848556978 podStartE2EDuration="2.70941239s" totalImagesPullingTime="1.860855412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:47.70824469 +0000 UTC m=+618.604710755" watchObservedRunningTime="2026-06-11 23:17:47.70941239 +0000 UTC m=+618.605878453" Jun 11 23:17:47.723653 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:47.723606 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" podStartSLOduration=1.533818794 podStartE2EDuration="2.723589435s" totalImagesPullingTime="1.189770641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:47.721725916 +0000 UTC m=+618.618191981" watchObservedRunningTime="2026-06-11 23:17:47.723589435 +0000 UTC m=+618.620055499" Jun 11 23:17:47.931575 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:47.931552 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9px7k_96109df4-f969-48fc-9180-e89914e7b12a/registry-server/0.log" Jun 11 23:17:47.933861 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:47.933844 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" Jun 11 23:17:48.000881 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.000845 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jq4b\" (UniqueName: \"kubernetes.io/projected/96109df4-f969-48fc-9180-e89914e7b12a-kube-api-access-6jq4b\") pod \"96109df4-f969-48fc-9180-e89914e7b12a\" (UID: \"96109df4-f969-48fc-9180-e89914e7b12a\") " Jun 11 23:17:48.003122 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.003097 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96109df4-f969-48fc-9180-e89914e7b12a-kube-api-access-6jq4b" (OuterVolumeSpecName: "kube-api-access-6jq4b") pod "96109df4-f969-48fc-9180-e89914e7b12a" (UID: "96109df4-f969-48fc-9180-e89914e7b12a"). InnerVolumeSpecName "kube-api-access-6jq4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:17:48.102327 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.102293 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jq4b\" (UniqueName: \"kubernetes.io/projected/96109df4-f969-48fc-9180-e89914e7b12a-kube-api-access-6jq4b\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:17:48.702243 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.702210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9px7k_96109df4-f969-48fc-9180-e89914e7b12a/registry-server/0.log" Jun 11 23:17:48.702724 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.702253 2581 generic.go:356] "Generic (PLEG): container finished" podID="96109df4-f969-48fc-9180-e89914e7b12a" containerID="ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93" exitCode=2 Jun 11 23:17:48.702724 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.702320 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" Jun 11 23:17:48.702724 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.702344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" event={"ID":"96109df4-f969-48fc-9180-e89914e7b12a","Type":"ContainerDied","Data":"ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93"} Jun 11 23:17:48.702724 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.702394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9px7k" event={"ID":"96109df4-f969-48fc-9180-e89914e7b12a","Type":"ContainerDied","Data":"40fe99fdfac7c658d198045eaef82429568f97c4e4d600c99d9b8725f4a5f0f7"} Jun 11 23:17:48.702724 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.702426 2581 scope.go:117] "RemoveContainer" containerID="ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93" Jun 11 23:17:48.711794 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.711778 2581 scope.go:117] "RemoveContainer" containerID="ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93" Jun 11 23:17:48.712056 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:17:48.712037 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93\": container with ID starting with ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93 not found: ID does not exist" containerID="ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93" Jun 11 23:17:48.712105 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.712065 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93"} err="failed to get container status \"ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93\": rpc error: code = NotFound desc = could not find container \"ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93\": container with ID starting with ddb5637cb3ec534397930d2c037f843544780245689fe71afeb8728e64204d93 not found: ID does not exist" Jun 11 23:17:48.722756 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.722732 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9px7k"] Jun 11 23:17:48.726407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:48.726385 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9px7k"] Jun 11 23:17:49.570504 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:49.570473 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96109df4-f969-48fc-9180-e89914e7b12a" path="/var/lib/kubelet/pods/96109df4-f969-48fc-9180-e89914e7b12a/volumes" Jun 11 23:17:56.187518 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:56.187476 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:56.188024 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:56.187552 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:56.209792 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:56.209766 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:17:56.754816 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:17:56.754792 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xldgq" Jun 11 23:18:13.535060 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.535023 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5"] Jun 11 23:18:13.535417 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.535290 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96109df4-f969-48fc-9180-e89914e7b12a" containerName="registry-server" Jun 11 23:18:13.535417 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.535301 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96109df4-f969-48fc-9180-e89914e7b12a" containerName="registry-server" Jun 11 23:18:13.535417 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.535344 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96109df4-f969-48fc-9180-e89914e7b12a" containerName="registry-server" Jun 11 23:18:13.545334 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.545310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.551665 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.551644 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8knmt\"" Jun 11 23:18:13.558714 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.558691 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5"] Jun 11 23:18:13.707099 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.707057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.707276 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.707128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2tn7\" (UniqueName: \"kubernetes.io/projected/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-kube-api-access-d2tn7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.808151 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.808053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.808151 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.808096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tn7\" (UniqueName: \"kubernetes.io/projected/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-kube-api-access-d2tn7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.808576 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.808554 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.817577 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.817544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2tn7\" (UniqueName: \"kubernetes.io/projected/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-kube-api-access-d2tn7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.855365 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.855328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:13.993535 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:13.993513 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5"] Jun 11 23:18:13.996501 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:18:13.996460 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc763e8a_5eb1_4f3b_bd01_1c21a255a622.slice/crio-ef8904fca6113a13d2ca89ef9c848d7bd87b008b23fb279af2bb29cb876e6c01 WatchSource:0}: Error finding container ef8904fca6113a13d2ca89ef9c848d7bd87b008b23fb279af2bb29cb876e6c01: Status 404 returned error can't find the container with id ef8904fca6113a13d2ca89ef9c848d7bd87b008b23fb279af2bb29cb876e6c01 Jun 11 23:18:14.800803 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:14.800761 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" event={"ID":"cc763e8a-5eb1-4f3b-bd01-1c21a255a622","Type":"ContainerStarted","Data":"ef8904fca6113a13d2ca89ef9c848d7bd87b008b23fb279af2bb29cb876e6c01"} Jun 11 23:18:18.340734 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.340651 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r"] Jun 11 23:18:18.343861 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.343840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" Jun 11 23:18:18.346342 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.346312 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 23:18:18.346486 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.346414 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cpbc8\"" Jun 11 23:18:18.357851 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.357823 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r"] Jun 11 23:18:18.442720 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.442682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47fj\" (UniqueName: \"kubernetes.io/projected/4c1f7fe2-1b9c-433b-97d2-4d2280ca7338-kube-api-access-b47fj\") pod \"dns-operator-controller-manager-864dd78c4c-xv68r\" (UID: \"4c1f7fe2-1b9c-433b-97d2-4d2280ca7338\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" Jun 11 23:18:18.543831 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.543792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47fj\" (UniqueName: \"kubernetes.io/projected/4c1f7fe2-1b9c-433b-97d2-4d2280ca7338-kube-api-access-b47fj\") pod \"dns-operator-controller-manager-864dd78c4c-xv68r\" (UID: \"4c1f7fe2-1b9c-433b-97d2-4d2280ca7338\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" Jun 11 23:18:18.564393 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.564358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47fj\" (UniqueName: \"kubernetes.io/projected/4c1f7fe2-1b9c-433b-97d2-4d2280ca7338-kube-api-access-b47fj\") pod \"dns-operator-controller-manager-864dd78c4c-xv68r\" (UID: \"4c1f7fe2-1b9c-433b-97d2-4d2280ca7338\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" Jun 11 23:18:18.653268 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.653231 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" Jun 11 23:18:18.798012 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.797975 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r"] Jun 11 23:18:18.801706 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:18:18.801661 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1f7fe2_1b9c_433b_97d2_4d2280ca7338.slice/crio-e67fc618d284e259100ba64a642403923959564fce082e5d4e14ce8249c0a7bd WatchSource:0}: Error finding container e67fc618d284e259100ba64a642403923959564fce082e5d4e14ce8249c0a7bd: Status 404 returned error can't find the container with id e67fc618d284e259100ba64a642403923959564fce082e5d4e14ce8249c0a7bd Jun 11 23:18:18.818893 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.818866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" event={"ID":"4c1f7fe2-1b9c-433b-97d2-4d2280ca7338","Type":"ContainerStarted","Data":"e67fc618d284e259100ba64a642403923959564fce082e5d4e14ce8249c0a7bd"} Jun 11 23:18:18.820403 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.820376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" event={"ID":"cc763e8a-5eb1-4f3b-bd01-1c21a255a622","Type":"ContainerStarted","Data":"4f238cdafb3694a73023a1818de226aedb56fbf7071b9087d97cba661607a272"} Jun 11 23:18:18.820626 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.820603 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:18.839640 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:18.839589 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" podStartSLOduration=1.784482999 podStartE2EDuration="5.839573833s" totalImagesPullingTime="4.055090834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:18.839024997 +0000 UTC m=+649.735491062" watchObservedRunningTime="2026-06-11 23:18:18.839573833 +0000 UTC m=+649.736039897" Jun 11 23:18:20.409703 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.409664 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw"] Jun 11 23:18:20.413211 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.413189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:20.415811 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.415788 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hhtz9\"" Jun 11 23:18:20.422574 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.422535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw"] Jun 11 23:18:20.461908 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.461870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pq2z\" (UniqueName: \"kubernetes.io/projected/ecaa5955-f4e0-483a-8722-9cc55cd5fbc4-kube-api-access-9pq2z\") pod \"limitador-operator-controller-manager-859d7b78bd-bjjtw\" (UID: \"ecaa5955-f4e0-483a-8722-9cc55cd5fbc4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:20.563045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.562988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pq2z\" (UniqueName: \"kubernetes.io/projected/ecaa5955-f4e0-483a-8722-9cc55cd5fbc4-kube-api-access-9pq2z\") pod \"limitador-operator-controller-manager-859d7b78bd-bjjtw\" (UID: \"ecaa5955-f4e0-483a-8722-9cc55cd5fbc4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:20.572806 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.572771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pq2z\" (UniqueName: \"kubernetes.io/projected/ecaa5955-f4e0-483a-8722-9cc55cd5fbc4-kube-api-access-9pq2z\") pod \"limitador-operator-controller-manager-859d7b78bd-bjjtw\" (UID: \"ecaa5955-f4e0-483a-8722-9cc55cd5fbc4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:20.726837 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.726757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:20.830657 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.830625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" event={"ID":"4c1f7fe2-1b9c-433b-97d2-4d2280ca7338","Type":"ContainerStarted","Data":"46f39894100e266134afec3bc1700a0132927104ec5b009d726c59315bcca0a4"} Jun 11 23:18:20.830844 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.830762 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" Jun 11 23:18:20.854695 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.854644 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" podStartSLOduration=0.918814073 podStartE2EDuration="2.854625257s" totalImagesPullingTime="1.935811184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:20.853291347 +0000 UTC m=+651.749757413" watchObservedRunningTime="2026-06-11 23:18:20.854625257 +0000 UTC m=+651.751091322" Jun 11 23:18:20.872344 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:20.872321 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw"] Jun 11 23:18:20.874395 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:18:20.874366 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecaa5955_f4e0_483a_8722_9cc55cd5fbc4.slice/crio-8fb92f70f9445220191826280b2957fa3534618c300b9336a079c8d8c180a1eb WatchSource:0}: Error finding container 8fb92f70f9445220191826280b2957fa3534618c300b9336a079c8d8c180a1eb: Status 404 returned error can't find the container with id 8fb92f70f9445220191826280b2957fa3534618c300b9336a079c8d8c180a1eb Jun 11 23:18:21.124122 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.124087 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7"] Jun 11 23:18:21.127432 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.127409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.129961 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.129933 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 23:18:21.130088 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.130010 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lptvr\"" Jun 11 23:18:21.130166 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.130146 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 23:18:21.137357 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.137333 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7"] Jun 11 23:18:21.167193 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.167158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.167380 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.167208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957jf\" (UniqueName: \"kubernetes.io/projected/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-kube-api-access-957jf\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.167380 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.167313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.268504 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.268442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957jf\" (UniqueName: \"kubernetes.io/projected/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-kube-api-access-957jf\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.268668 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.268540 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.268668 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.268577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.268742 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:21.268709 2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 23:18:21.268837 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:21.268823 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert podName:e35ca488-79c4-4984-b7d2-ecf24fdeaf77 nodeName:}" failed. No retries permitted until 2026-06-11 23:18:21.768800627 +0000 UTC m=+652.665266672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pkzj7" (UID: "e35ca488-79c4-4984-b7d2-ecf24fdeaf77") : secret "plugin-serving-cert" not found Jun 11 23:18:21.269154 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.269138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.285821 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.285788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-957jf\" (UniqueName: \"kubernetes.io/projected/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-kube-api-access-957jf\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.775851 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.775800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:21.776282 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:21.775986 2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 23:18:21.776282 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:21.776065 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert podName:e35ca488-79c4-4984-b7d2-ecf24fdeaf77 nodeName:}" failed. No retries permitted until 2026-06-11 23:18:22.776044689 +0000 UTC m=+653.672510744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pkzj7" (UID: "e35ca488-79c4-4984-b7d2-ecf24fdeaf77") : secret "plugin-serving-cert" not found Jun 11 23:18:21.835675 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:21.835638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" event={"ID":"ecaa5955-f4e0-483a-8722-9cc55cd5fbc4","Type":"ContainerStarted","Data":"8fb92f70f9445220191826280b2957fa3534618c300b9336a079c8d8c180a1eb"} Jun 11 23:18:22.784873 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:22.784826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:22.787398 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:22.787378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e35ca488-79c4-4984-b7d2-ecf24fdeaf77-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pkzj7\" (UID: \"e35ca488-79c4-4984-b7d2-ecf24fdeaf77\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:22.840857 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:22.840824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" event={"ID":"ecaa5955-f4e0-483a-8722-9cc55cd5fbc4","Type":"ContainerStarted","Data":"b1e3cc136112a4197223817425b7fa6803fd38e3a7c60a0badec7b3be3ac75fc"} Jun 11 23:18:22.841039 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:22.840966 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:22.858399 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:22.858350 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" podStartSLOduration=1.488801324 podStartE2EDuration="2.858333639s" totalImagesPullingTime="1.369532315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:22.856830147 +0000 UTC m=+653.753296213" watchObservedRunningTime="2026-06-11 23:18:22.858333639 +0000 UTC m=+653.754799703" Jun 11 23:18:22.937910 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:22.937871 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" Jun 11 23:18:23.063861 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:23.063779 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7"] Jun 11 23:18:23.066820 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:18:23.066795 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode35ca488_79c4_4984_b7d2_ecf24fdeaf77.slice/crio-2fad8c926169f2a819f3e8909878e1a4441006757519de7c7101205a86c1b0c8 WatchSource:0}: Error finding container 2fad8c926169f2a819f3e8909878e1a4441006757519de7c7101205a86c1b0c8: Status 404 returned error can't find the container with id 2fad8c926169f2a819f3e8909878e1a4441006757519de7c7101205a86c1b0c8 Jun 11 23:18:23.848503 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:23.848368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" event={"ID":"e35ca488-79c4-4984-b7d2-ecf24fdeaf77","Type":"ContainerStarted","Data":"2fad8c926169f2a819f3e8909878e1a4441006757519de7c7101205a86c1b0c8"} Jun 11 23:18:29.827460 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:29.827356 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:31.526633 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.526592 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5"] Jun 11 23:18:31.527108 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.526800 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" containerName="manager" containerID="cri-o://4f238cdafb3694a73023a1818de226aedb56fbf7071b9087d97cba661607a272" gracePeriod=2 Jun 11 23:18:31.537231 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.537199 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5"] Jun 11 23:18:31.538509 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:31.538426 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:31.557750 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.557074 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw"] Jun 11 23:18:31.557750 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.557301 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" containerName="manager" containerID="cri-o://b1e3cc136112a4197223817425b7fa6803fd38e3a7c60a0badec7b3be3ac75fc" gracePeriod=2 Jun 11 23:18:31.560280 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:31.560110 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:31.561820 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.561792 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw"] Jun 11 23:18:31.563026 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:31.562475 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjjtw\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:31.591637 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.591344 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz"] Jun 11 23:18:31.591812 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.591790 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" containerName="manager" Jun 11 23:18:31.591887 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.591817 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" containerName="manager" Jun 11 23:18:31.591887 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.591839 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" containerName="manager" Jun 11 23:18:31.591887 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.591848 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" containerName="manager" Jun 11 23:18:31.592038 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.591924 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" containerName="manager" Jun 11 23:18:31.592038 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.591937 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" containerName="manager" Jun 11 23:18:31.594823 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.594803 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" Jun 11 23:18:31.612782 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.612747 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz"] Jun 11 23:18:31.664432 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.664396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct596\" (UniqueName: \"kubernetes.io/projected/5a6bb8d6-db62-40b9-baeb-a749c6118e67-kube-api-access-ct596\") pod \"limitador-operator-controller-manager-859d7b78bd-x6jdz\" (UID: \"5a6bb8d6-db62-40b9-baeb-a749c6118e67\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" Jun 11 23:18:31.721967 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.721930 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm"] Jun 11 23:18:31.725205 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.725183 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:31.740487 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.740438 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm"] Jun 11 23:18:31.765625 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.765588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct596\" (UniqueName: \"kubernetes.io/projected/5a6bb8d6-db62-40b9-baeb-a749c6118e67-kube-api-access-ct596\") pod \"limitador-operator-controller-manager-859d7b78bd-x6jdz\" (UID: \"5a6bb8d6-db62-40b9-baeb-a749c6118e67\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" Jun 11 23:18:31.765796 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.765644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzqjg\" (UniqueName: \"kubernetes.io/projected/f21b88e1-95f2-4a3f-91bc-e0be4a2f250c-kube-api-access-hzqjg\") pod \"kuadrant-operator-controller-manager-86878c769f-mvrvm\" (UID: \"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:31.765796 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.765728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f21b88e1-95f2-4a3f-91bc-e0be4a2f250c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mvrvm\" (UID: \"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:31.797882 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.797801 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct596\" (UniqueName: \"kubernetes.io/projected/5a6bb8d6-db62-40b9-baeb-a749c6118e67-kube-api-access-ct596\") pod \"limitador-operator-controller-manager-859d7b78bd-x6jdz\" (UID: \"5a6bb8d6-db62-40b9-baeb-a749c6118e67\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" Jun 11 23:18:31.838178 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.838146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xv68r" Jun 11 23:18:31.866765 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.866734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f21b88e1-95f2-4a3f-91bc-e0be4a2f250c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mvrvm\" (UID: \"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:31.866948 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.866800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzqjg\" (UniqueName: \"kubernetes.io/projected/f21b88e1-95f2-4a3f-91bc-e0be4a2f250c-kube-api-access-hzqjg\") pod \"kuadrant-operator-controller-manager-86878c769f-mvrvm\" (UID: \"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:31.867379 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.867353 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f21b88e1-95f2-4a3f-91bc-e0be4a2f250c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mvrvm\" (UID: \"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:31.880748 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.880716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzqjg\" (UniqueName: \"kubernetes.io/projected/f21b88e1-95f2-4a3f-91bc-e0be4a2f250c-kube-api-access-hzqjg\") pod \"kuadrant-operator-controller-manager-86878c769f-mvrvm\" (UID: \"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:31.976377 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:31.976342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" Jun 11 23:18:32.038013 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:32.037977 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:43.953305 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:43.953173 2581 generic.go:356] "Generic (PLEG): container finished" podID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" containerID="b1e3cc136112a4197223817425b7fa6803fd38e3a7c60a0badec7b3be3ac75fc" exitCode=0 Jun 11 23:18:43.955207 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:43.955185 2581 generic.go:356] "Generic (PLEG): container finished" podID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" containerID="4f238cdafb3694a73023a1818de226aedb56fbf7071b9087d97cba661607a272" exitCode=0 Jun 11 23:18:43.992398 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:43.992369 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:43.993534 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:43.993512 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz"] Jun 11 23:18:43.994627 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:43.994592 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:43.995731 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:18:43.995708 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6bb8d6_db62_40b9_baeb_a749c6118e67.slice/crio-bfd8da08ec846e7a5fee9ad0fb974f1cd693c892b162c8722f0db7f85503a380 WatchSource:0}: Error finding container bfd8da08ec846e7a5fee9ad0fb974f1cd693c892b162c8722f0db7f85503a380: Status 404 returned error can't find the container with id bfd8da08ec846e7a5fee9ad0fb974f1cd693c892b162c8722f0db7f85503a380 Jun 11 23:18:44.003908 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.003889 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:44.006146 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:44.006101 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:44.007991 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:44.007957 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjjtw\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:44.021543 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.021516 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm"] Jun 11 23:18:44.026668 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:18:44.026638 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21b88e1_95f2_4a3f_91bc_e0be4a2f250c.slice/crio-357871c4fe968a372219a1465e180112ce325f36607fc62a567f3b1133c8c782 WatchSource:0}: Error finding container 357871c4fe968a372219a1465e180112ce325f36607fc62a567f3b1133c8c782: Status 404 returned error can't find the container with id 357871c4fe968a372219a1465e180112ce325f36607fc62a567f3b1133c8c782 Jun 11 23:18:44.085329 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.085298 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pq2z\" (UniqueName: \"kubernetes.io/projected/ecaa5955-f4e0-483a-8722-9cc55cd5fbc4-kube-api-access-9pq2z\") pod \"ecaa5955-f4e0-483a-8722-9cc55cd5fbc4\" (UID: \"ecaa5955-f4e0-483a-8722-9cc55cd5fbc4\") " Jun 11 23:18:44.085508 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.085401 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2tn7\" (UniqueName: \"kubernetes.io/projected/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-kube-api-access-d2tn7\") pod \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " Jun 11 23:18:44.085508 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.085496 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-extensions-socket-volume\") pod \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\" (UID: \"cc763e8a-5eb1-4f3b-bd01-1c21a255a622\") " Jun 11 23:18:44.086058 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.085999 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc763e8a-5eb1-4f3b-bd01-1c21a255a622" (UID: "cc763e8a-5eb1-4f3b-bd01-1c21a255a622"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:44.087713 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.087678 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-kube-api-access-d2tn7" (OuterVolumeSpecName: "kube-api-access-d2tn7") pod "cc763e8a-5eb1-4f3b-bd01-1c21a255a622" (UID: "cc763e8a-5eb1-4f3b-bd01-1c21a255a622"). InnerVolumeSpecName "kube-api-access-d2tn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:44.087713 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.087698 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecaa5955-f4e0-483a-8722-9cc55cd5fbc4-kube-api-access-9pq2z" (OuterVolumeSpecName: "kube-api-access-9pq2z") pod "ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" (UID: "ecaa5955-f4e0-483a-8722-9cc55cd5fbc4"). InnerVolumeSpecName "kube-api-access-9pq2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:44.186982 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.186945 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2tn7\" (UniqueName: \"kubernetes.io/projected/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-kube-api-access-d2tn7\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:18:44.186982 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.186984 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc763e8a-5eb1-4f3b-bd01-1c21a255a622-extensions-socket-volume\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:18:44.187189 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.186999 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pq2z\" (UniqueName: \"kubernetes.io/projected/ecaa5955-f4e0-483a-8722-9cc55cd5fbc4-kube-api-access-9pq2z\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:18:44.961813 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.961767 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" event={"ID":"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c","Type":"ContainerStarted","Data":"fb3f7920daa8ad0c2f802318c8960bb09f00986ef6a151c06856e464e54dbd1f"} Jun 11 23:18:44.962220 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.961833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" event={"ID":"f21b88e1-95f2-4a3f-91bc-e0be4a2f250c","Type":"ContainerStarted","Data":"357871c4fe968a372219a1465e180112ce325f36607fc62a567f3b1133c8c782"} Jun 11 23:18:44.962220 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.961947 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:18:44.963264 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.963237 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" event={"ID":"5a6bb8d6-db62-40b9-baeb-a749c6118e67","Type":"ContainerStarted","Data":"4886fe3582efd378d46576e646a057a1a5b0d493bb5759b0d5cf7e7fae634f06"} Jun 11 23:18:44.963390 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.963283 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" event={"ID":"5a6bb8d6-db62-40b9-baeb-a749c6118e67","Type":"ContainerStarted","Data":"bfd8da08ec846e7a5fee9ad0fb974f1cd693c892b162c8722f0db7f85503a380"} Jun 11 23:18:44.963390 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.963305 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" Jun 11 23:18:44.964020 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:44.963987 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:44.964528 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.964514 2581 scope.go:117] "RemoveContainer" containerID="b1e3cc136112a4197223817425b7fa6803fd38e3a7c60a0badec7b3be3ac75fc" Jun 11 23:18:44.964593 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.964511 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:44.965998 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.965975 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" event={"ID":"e35ca488-79c4-4984-b7d2-ecf24fdeaf77","Type":"ContainerStarted","Data":"04612b6c29c5c67785f63e2e9ea1c2c7fafbe979ec21cc7dcb4d53d7a904e31b"} Jun 11 23:18:44.967412 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.967395 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:44.977439 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.977418 2581 scope.go:117] "RemoveContainer" containerID="4f238cdafb3694a73023a1818de226aedb56fbf7071b9087d97cba661607a272" Jun 11 23:18:44.984497 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:44.984434 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjjtw\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:44.984827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:44.984788 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" podStartSLOduration=13.984773708 podStartE2EDuration="13.984773708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:44.982424289 +0000 UTC m=+675.878890352" watchObservedRunningTime="2026-06-11 23:18:44.984773708 +0000 UTC m=+675.881239771" Jun 11 23:18:44.986284 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:44.986259 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gsgc5\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsgc5" Jun 11 23:18:44.988094 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:18:44.988068 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjjtw\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjjtw" Jun 11 23:18:45.003239 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:45.003194 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pkzj7" podStartSLOduration=3.145975323 podStartE2EDuration="24.003174947s" totalImagesPullingTime="20.857199624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:45.003050375 +0000 UTC m=+675.899516437" watchObservedRunningTime="2026-06-11 23:18:45.003174947 +0000 UTC m=+675.899641011" Jun 11 23:18:45.027781 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:45.027720 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" podStartSLOduration=14.027697988 podStartE2EDuration="14.027697988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:45.025622787 +0000 UTC m=+675.922088853" watchObservedRunningTime="2026-06-11 23:18:45.027697988 +0000 UTC m=+675.924164055" Jun 11 23:18:45.571177 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:45.571141 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc763e8a-5eb1-4f3b-bd01-1c21a255a622" path="/var/lib/kubelet/pods/cc763e8a-5eb1-4f3b-bd01-1c21a255a622/volumes" Jun 11 23:18:45.571473 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:45.571443 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecaa5955-f4e0-483a-8722-9cc55cd5fbc4" path="/var/lib/kubelet/pods/ecaa5955-f4e0-483a-8722-9cc55cd5fbc4/volumes" Jun 11 23:18:55.976188 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:55.976156 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6jdz" Jun 11 23:18:55.976720 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:18:55.976243 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvrvm" Jun 11 23:19:18.411804 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.411724 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-pxssr"] Jun 11 23:19:18.414106 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.414083 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pxssr" Jun 11 23:19:18.416711 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.416688 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gx7t2\"" Jun 11 23:19:18.422320 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.422299 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pxssr"] Jun 11 23:19:18.476668 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.476626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p25pt\" (UniqueName: \"kubernetes.io/projected/9499eaf7-41f5-40ce-b50f-e3e10f02f26e-kube-api-access-p25pt\") pod \"authorino-58cd955675-pxssr\" (UID: \"9499eaf7-41f5-40ce-b50f-e3e10f02f26e\") " pod="kuadrant-system/authorino-58cd955675-pxssr" Jun 11 23:19:18.545586 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.545551 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-c56dn"] Jun 11 23:19:18.547801 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.547784 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c56dn" Jun 11 23:19:18.555685 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.555626 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c56dn"] Jun 11 23:19:18.578003 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.577967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p25pt\" (UniqueName: \"kubernetes.io/projected/9499eaf7-41f5-40ce-b50f-e3e10f02f26e-kube-api-access-p25pt\") pod \"authorino-58cd955675-pxssr\" (UID: \"9499eaf7-41f5-40ce-b50f-e3e10f02f26e\") " pod="kuadrant-system/authorino-58cd955675-pxssr" Jun 11 23:19:18.586728 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.586698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p25pt\" (UniqueName: \"kubernetes.io/projected/9499eaf7-41f5-40ce-b50f-e3e10f02f26e-kube-api-access-p25pt\") pod \"authorino-58cd955675-pxssr\" (UID: \"9499eaf7-41f5-40ce-b50f-e3e10f02f26e\") " pod="kuadrant-system/authorino-58cd955675-pxssr" Jun 11 23:19:18.679050 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.678962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsp5m\" (UniqueName: \"kubernetes.io/projected/ccd55bcc-42e0-45f9-ad9e-5d7276a5d804-kube-api-access-qsp5m\") pod \"authorino-75d556bd77-c56dn\" (UID: \"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804\") " pod="kuadrant-system/authorino-75d556bd77-c56dn" Jun 11 23:19:18.723883 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.723848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pxssr" Jun 11 23:19:18.780227 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.780198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsp5m\" (UniqueName: \"kubernetes.io/projected/ccd55bcc-42e0-45f9-ad9e-5d7276a5d804-kube-api-access-qsp5m\") pod \"authorino-75d556bd77-c56dn\" (UID: \"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804\") " pod="kuadrant-system/authorino-75d556bd77-c56dn" Jun 11 23:19:18.789780 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.789752 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsp5m\" (UniqueName: \"kubernetes.io/projected/ccd55bcc-42e0-45f9-ad9e-5d7276a5d804-kube-api-access-qsp5m\") pod \"authorino-75d556bd77-c56dn\" (UID: \"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804\") " pod="kuadrant-system/authorino-75d556bd77-c56dn" Jun 11 23:19:18.851768 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.851739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pxssr"] Jun 11 23:19:18.854567 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:19:18.854539 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9499eaf7_41f5_40ce_b50f_e3e10f02f26e.slice/crio-223b34b492c5228bfcb035ddaf159ff1cba54cada583ff3831683e9866509a1f WatchSource:0}: Error finding container 223b34b492c5228bfcb035ddaf159ff1cba54cada583ff3831683e9866509a1f: Status 404 returned error can't find the container with id 223b34b492c5228bfcb035ddaf159ff1cba54cada583ff3831683e9866509a1f Jun 11 23:19:18.857531 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.857511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c56dn" Jun 11 23:19:18.984523 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:18.984493 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c56dn"] Jun 11 23:19:18.988423 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:19:18.988402 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccd55bcc_42e0_45f9_ad9e_5d7276a5d804.slice/crio-5f2a6215bacc2c8116ba8f012d27fc650f377fdeae6b4e2becbd6466e78fee35 WatchSource:0}: Error finding container 5f2a6215bacc2c8116ba8f012d27fc650f377fdeae6b4e2becbd6466e78fee35: Status 404 returned error can't find the container with id 5f2a6215bacc2c8116ba8f012d27fc650f377fdeae6b4e2becbd6466e78fee35 Jun 11 23:19:19.124330 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:19.124300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c56dn" event={"ID":"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804","Type":"ContainerStarted","Data":"5f2a6215bacc2c8116ba8f012d27fc650f377fdeae6b4e2becbd6466e78fee35"} Jun 11 23:19:19.125439 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:19.125405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pxssr" event={"ID":"9499eaf7-41f5-40ce-b50f-e3e10f02f26e","Type":"ContainerStarted","Data":"223b34b492c5228bfcb035ddaf159ff1cba54cada583ff3831683e9866509a1f"} Jun 11 23:19:23.147938 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:23.147903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c56dn" event={"ID":"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804","Type":"ContainerStarted","Data":"82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b"} Jun 11 23:19:23.149293 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:23.149262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pxssr" event={"ID":"9499eaf7-41f5-40ce-b50f-e3e10f02f26e","Type":"ContainerStarted","Data":"ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22"} Jun 11 23:19:23.163640 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:23.163594 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-c56dn" podStartSLOduration=2.051807001 podStartE2EDuration="5.16357952s" totalImagesPullingTime="3.111772519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:23.162881564 +0000 UTC m=+714.059347629" watchObservedRunningTime="2026-06-11 23:19:23.16357952 +0000 UTC m=+714.060045583" Jun 11 23:19:23.176938 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:23.176873 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-pxssr" podStartSLOduration=1.942591068 podStartE2EDuration="5.176861647s" totalImagesPullingTime="3.234270579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:23.175846432 +0000 UTC m=+714.072312497" watchObservedRunningTime="2026-06-11 23:19:23.176861647 +0000 UTC m=+714.073327711" Jun 11 23:19:23.200206 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:23.200163 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pxssr"] Jun 11 23:19:25.157862 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:25.157820 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-pxssr" podUID="9499eaf7-41f5-40ce-b50f-e3e10f02f26e" containerName="authorino" containerID="cri-o://ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22" gracePeriod=30 Jun 11 23:19:25.403689 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:25.403663 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pxssr" Jun 11 23:19:25.537220 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:25.537147 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p25pt\" (UniqueName: \"kubernetes.io/projected/9499eaf7-41f5-40ce-b50f-e3e10f02f26e-kube-api-access-p25pt\") pod \"9499eaf7-41f5-40ce-b50f-e3e10f02f26e\" (UID: \"9499eaf7-41f5-40ce-b50f-e3e10f02f26e\") " Jun 11 23:19:25.539250 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:25.539229 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9499eaf7-41f5-40ce-b50f-e3e10f02f26e-kube-api-access-p25pt" (OuterVolumeSpecName: "kube-api-access-p25pt") pod "9499eaf7-41f5-40ce-b50f-e3e10f02f26e" (UID: "9499eaf7-41f5-40ce-b50f-e3e10f02f26e"). InnerVolumeSpecName "kube-api-access-p25pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:19:25.637890 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:25.637849 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p25pt\" (UniqueName: \"kubernetes.io/projected/9499eaf7-41f5-40ce-b50f-e3e10f02f26e-kube-api-access-p25pt\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:19:26.162763 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.162719 2581 generic.go:356] "Generic (PLEG): container finished" podID="9499eaf7-41f5-40ce-b50f-e3e10f02f26e" containerID="ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22" exitCode=0 Jun 11 23:19:26.163235 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.162776 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pxssr" Jun 11 23:19:26.163235 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.162812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pxssr" event={"ID":"9499eaf7-41f5-40ce-b50f-e3e10f02f26e","Type":"ContainerDied","Data":"ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22"} Jun 11 23:19:26.163235 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.162852 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pxssr" event={"ID":"9499eaf7-41f5-40ce-b50f-e3e10f02f26e","Type":"ContainerDied","Data":"223b34b492c5228bfcb035ddaf159ff1cba54cada583ff3831683e9866509a1f"} Jun 11 23:19:26.163235 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.162869 2581 scope.go:117] "RemoveContainer" containerID="ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22" Jun 11 23:19:26.170854 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.170835 2581 scope.go:117] "RemoveContainer" containerID="ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22" Jun 11 23:19:26.171153 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:19:26.171134 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22\": container with ID starting with ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22 not found: ID does not exist" containerID="ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22" Jun 11 23:19:26.171220 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.171163 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22"} err="failed to get container status \"ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22\": rpc error: code = NotFound desc = could not find container \"ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22\": container with ID starting with ee746391f0f02c0de6fddc6a149930a2483dfbc35e6dc9525f15e9116a9fbc22 not found: ID does not exist" Jun 11 23:19:26.178266 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.178241 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pxssr"] Jun 11 23:19:26.182120 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:26.182100 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-pxssr"] Jun 11 23:19:27.570437 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:19:27.570404 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9499eaf7-41f5-40ce-b50f-e3e10f02f26e" path="/var/lib/kubelet/pods/9499eaf7-41f5-40ce-b50f-e3e10f02f26e/volumes" Jun 11 23:20:12.608655 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.608619 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:20:12.609123 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.608933 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9499eaf7-41f5-40ce-b50f-e3e10f02f26e" containerName="authorino" Jun 11 23:20:12.609123 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.608946 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9499eaf7-41f5-40ce-b50f-e3e10f02f26e" containerName="authorino" Jun 11 23:20:12.609123 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.609018 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9499eaf7-41f5-40ce-b50f-e3e10f02f26e" containerName="authorino" Jun 11 23:20:12.613372 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.613352 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:12.620403 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.619887 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zg9t5\"" Jun 11 23:20:12.620403 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.619901 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 23:20:12.620403 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.620170 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 23:20:12.620600 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.620428 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 23:20:12.631834 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.631812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:20:12.701524 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.701493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzc4n\" (UniqueName: \"kubernetes.io/projected/f1d56e26-0530-4ebd-862f-34721b14882f-kube-api-access-nzc4n\") pod \"maas-keycloak-0\" (UID: \"f1d56e26-0530-4ebd-862f-34721b14882f\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:12.801929 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.801893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzc4n\" (UniqueName: \"kubernetes.io/projected/f1d56e26-0530-4ebd-862f-34721b14882f-kube-api-access-nzc4n\") pod \"maas-keycloak-0\" (UID: \"f1d56e26-0530-4ebd-862f-34721b14882f\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:12.812026 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.811995 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzc4n\" (UniqueName: \"kubernetes.io/projected/f1d56e26-0530-4ebd-862f-34721b14882f-kube-api-access-nzc4n\") pod \"maas-keycloak-0\" (UID: \"f1d56e26-0530-4ebd-862f-34721b14882f\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:12.926826 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:12.926734 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:13.062242 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:13.062208 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:20:13.065924 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:20:13.065889 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d56e26_0530_4ebd_862f_34721b14882f.slice/crio-180631d4304c6930b1368e18f28f338533c13e0cd9e03fc849f7006f78dfc8d1 WatchSource:0}: Error finding container 180631d4304c6930b1368e18f28f338533c13e0cd9e03fc849f7006f78dfc8d1: Status 404 returned error can't find the container with id 180631d4304c6930b1368e18f28f338533c13e0cd9e03fc849f7006f78dfc8d1 Jun 11 23:20:13.360105 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:13.360076 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f1d56e26-0530-4ebd-862f-34721b14882f","Type":"ContainerStarted","Data":"180631d4304c6930b1368e18f28f338533c13e0cd9e03fc849f7006f78dfc8d1"} Jun 11 23:20:18.389281 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:18.389231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f1d56e26-0530-4ebd-862f-34721b14882f","Type":"ContainerStarted","Data":"220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b"} Jun 11 23:20:18.408903 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:18.408836 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.053544405 podStartE2EDuration="6.408815344s" totalImagesPullingTime="4.355270939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:18.40672016 +0000 UTC m=+769.303186226" watchObservedRunningTime="2026-06-11 23:20:18.408815344 +0000 UTC m=+769.305281409" Jun 11 23:20:18.927470 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:18.927401 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:18.929216 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:18.929164 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:19.928024 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:19.927974 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:20.928218 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:20.928167 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:21.927630 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:21.927579 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:22.927606 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:22.927563 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:22.929170 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:22.929132 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:23.928221 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:23.928173 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:24.928126 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:24.928076 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:25.927644 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:25.927584 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:26.927482 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:26.927412 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:27.927953 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:27.927901 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:28.927427 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:28.927377 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:29.927460 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:29.927387 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 11 23:20:31.053519 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:31.053482 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:31.073861 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:31.072668 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:20:41.060083 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:41.060051 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:20:41.997330 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:41.997288 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mr5fr"] Jun 11 23:20:42.004880 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.004854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" Jun 11 23:20:42.009913 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.009883 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mr5fr"] Jun 11 23:20:42.070996 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.070957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26bpg\" (UniqueName: \"kubernetes.io/projected/04f6e28a-57ee-42e6-b72b-ff5a164735ea-kube-api-access-26bpg\") pod \"authorino-5d4b67c446-mr5fr\" (UID: \"04f6e28a-57ee-42e6-b72b-ff5a164735ea\") " pod="kuadrant-system/authorino-5d4b67c446-mr5fr" Jun 11 23:20:42.172128 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.172091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26bpg\" (UniqueName: \"kubernetes.io/projected/04f6e28a-57ee-42e6-b72b-ff5a164735ea-kube-api-access-26bpg\") pod \"authorino-5d4b67c446-mr5fr\" (UID: \"04f6e28a-57ee-42e6-b72b-ff5a164735ea\") " pod="kuadrant-system/authorino-5d4b67c446-mr5fr" Jun 11 23:20:42.180732 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.180701 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26bpg\" (UniqueName: \"kubernetes.io/projected/04f6e28a-57ee-42e6-b72b-ff5a164735ea-kube-api-access-26bpg\") pod \"authorino-5d4b67c446-mr5fr\" (UID: \"04f6e28a-57ee-42e6-b72b-ff5a164735ea\") " pod="kuadrant-system/authorino-5d4b67c446-mr5fr" Jun 11 23:20:42.228267 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.228222 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mr5fr"] Jun 11 23:20:42.228762 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.228737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" Jun 11 23:20:42.249942 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.249869 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f858794f4-gtqng"] Jun 11 23:20:42.252989 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.252966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:20:42.260302 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.260275 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f858794f4-gtqng"] Jun 11 23:20:42.354482 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.354432 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f858794f4-gtqng"] Jun 11 23:20:42.354746 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:20:42.354721 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d8f8r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-f858794f4-gtqng" podUID="adaba88f-a5af-4ef7-8a94-44e5ff67debd" Jun 11 23:20:42.367982 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.367959 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mr5fr"] Jun 11 23:20:42.370390 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:20:42.370354 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04f6e28a_57ee_42e6_b72b_ff5a164735ea.slice/crio-90e201fc108fabca8a6ad741a7c5b884e25a04cdbc56e04d0d923a3929589805 WatchSource:0}: Error finding container 90e201fc108fabca8a6ad741a7c5b884e25a04cdbc56e04d0d923a3929589805: Status 404 returned error can't find the container with id 90e201fc108fabca8a6ad741a7c5b884e25a04cdbc56e04d0d923a3929589805 Jun 11 23:20:42.371871 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.371852 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:20:42.373716 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.373692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8f8r\" (UniqueName: \"kubernetes.io/projected/adaba88f-a5af-4ef7-8a94-44e5ff67debd-kube-api-access-d8f8r\") pod \"authorino-f858794f4-gtqng\" (UID: \"adaba88f-a5af-4ef7-8a94-44e5ff67debd\") " pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:20:42.381675 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.381654 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56747c5c5d-96w8h"] Jun 11 23:20:42.383908 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.383890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.386307 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.386290 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 23:20:42.392928 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.392905 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56747c5c5d-96w8h"] Jun 11 23:20:42.474538 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.474507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8f8r\" (UniqueName: \"kubernetes.io/projected/adaba88f-a5af-4ef7-8a94-44e5ff67debd-kube-api-access-d8f8r\") pod \"authorino-f858794f4-gtqng\" (UID: \"adaba88f-a5af-4ef7-8a94-44e5ff67debd\") " pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:20:42.474695 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.474551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hksnd\" (UniqueName: \"kubernetes.io/projected/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-kube-api-access-hksnd\") pod \"authorino-56747c5c5d-96w8h\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.474695 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.474583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-tls-cert\") pod \"authorino-56747c5c5d-96w8h\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.482856 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.482830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8f8r\" (UniqueName: \"kubernetes.io/projected/adaba88f-a5af-4ef7-8a94-44e5ff67debd-kube-api-access-d8f8r\") pod \"authorino-f858794f4-gtqng\" (UID: \"adaba88f-a5af-4ef7-8a94-44e5ff67debd\") " pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:20:42.512127 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.512046 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:20:42.512127 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.512080 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" event={"ID":"04f6e28a-57ee-42e6-b72b-ff5a164735ea","Type":"ContainerStarted","Data":"90e201fc108fabca8a6ad741a7c5b884e25a04cdbc56e04d0d923a3929589805"} Jun 11 23:20:42.517826 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.517808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:20:42.575773 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.575736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-tls-cert\") pod \"authorino-56747c5c5d-96w8h\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.575939 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.575841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hksnd\" (UniqueName: \"kubernetes.io/projected/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-kube-api-access-hksnd\") pod \"authorino-56747c5c5d-96w8h\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.578332 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.578313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-tls-cert\") pod \"authorino-56747c5c5d-96w8h\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.582979 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.582959 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hksnd\" (UniqueName: \"kubernetes.io/projected/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-kube-api-access-hksnd\") pod \"authorino-56747c5c5d-96w8h\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.676650 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.676617 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8f8r\" (UniqueName: \"kubernetes.io/projected/adaba88f-a5af-4ef7-8a94-44e5ff67debd-kube-api-access-d8f8r\") pod \"adaba88f-a5af-4ef7-8a94-44e5ff67debd\" (UID: \"adaba88f-a5af-4ef7-8a94-44e5ff67debd\") " Jun 11 23:20:42.678861 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.678831 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adaba88f-a5af-4ef7-8a94-44e5ff67debd-kube-api-access-d8f8r" (OuterVolumeSpecName: "kube-api-access-d8f8r") pod "adaba88f-a5af-4ef7-8a94-44e5ff67debd" (UID: "adaba88f-a5af-4ef7-8a94-44e5ff67debd"). InnerVolumeSpecName "kube-api-access-d8f8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:20:42.693998 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.693969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:20:42.777757 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.777720 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8f8r\" (UniqueName: \"kubernetes.io/projected/adaba88f-a5af-4ef7-8a94-44e5ff67debd-kube-api-access-d8f8r\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:20:42.841068 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:42.841042 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56747c5c5d-96w8h"] Jun 11 23:20:42.844136 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:20:42.844104 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6520f553_3af9_40b3_9c4b_c3acbed2f8c4.slice/crio-9920c92c318ae53ab829d8f7a7f134b156f4e9590389c3d25651ad0b39f2ded9 WatchSource:0}: Error finding container 9920c92c318ae53ab829d8f7a7f134b156f4e9590389c3d25651ad0b39f2ded9: Status 404 returned error can't find the container with id 9920c92c318ae53ab829d8f7a7f134b156f4e9590389c3d25651ad0b39f2ded9 Jun 11 23:20:43.517710 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.517601 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" event={"ID":"04f6e28a-57ee-42e6-b72b-ff5a164735ea","Type":"ContainerStarted","Data":"789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c"} Jun 11 23:20:43.517710 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.517616 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" podUID="04f6e28a-57ee-42e6-b72b-ff5a164735ea" containerName="authorino" containerID="cri-o://789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c" gracePeriod=30 Jun 11 23:20:43.519267 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.519241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56747c5c5d-96w8h" event={"ID":"6520f553-3af9-40b3-9c4b-c3acbed2f8c4","Type":"ContainerStarted","Data":"5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e"} Jun 11 23:20:43.519408 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.519279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56747c5c5d-96w8h" event={"ID":"6520f553-3af9-40b3-9c4b-c3acbed2f8c4","Type":"ContainerStarted","Data":"9920c92c318ae53ab829d8f7a7f134b156f4e9590389c3d25651ad0b39f2ded9"} Jun 11 23:20:43.519408 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.519323 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:20:43.532741 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.532679 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" podStartSLOduration=2.171916067 podStartE2EDuration="2.532663042s" totalImagesPullingTime="360.746975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:43.531880764 +0000 UTC m=+794.428346828" watchObservedRunningTime="2026-06-11 23:20:43.532663042 +0000 UTC m=+794.429129110" Jun 11 23:20:43.550381 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.550332 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56747c5c5d-96w8h" podStartSLOduration=1.221274641 podStartE2EDuration="1.550319056s" totalImagesPullingTime="329.044415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:43.54923462 +0000 UTC m=+794.445700685" watchObservedRunningTime="2026-06-11 23:20:43.550319056 +0000 UTC m=+794.446785137" Jun 11 23:20:43.572546 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.572515 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c56dn"] Jun 11 23:20:43.572698 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.572679 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-c56dn" podUID="ccd55bcc-42e0-45f9-ad9e-5d7276a5d804" containerName="authorino" containerID="cri-o://82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b" gracePeriod=30 Jun 11 23:20:43.828973 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.828948 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" Jun 11 23:20:43.852830 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.852803 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c56dn" Jun 11 23:20:43.989130 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.989091 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26bpg\" (UniqueName: \"kubernetes.io/projected/04f6e28a-57ee-42e6-b72b-ff5a164735ea-kube-api-access-26bpg\") pod \"04f6e28a-57ee-42e6-b72b-ff5a164735ea\" (UID: \"04f6e28a-57ee-42e6-b72b-ff5a164735ea\") " Jun 11 23:20:43.989306 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.989139 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsp5m\" (UniqueName: \"kubernetes.io/projected/ccd55bcc-42e0-45f9-ad9e-5d7276a5d804-kube-api-access-qsp5m\") pod \"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804\" (UID: \"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804\") " Jun 11 23:20:43.991488 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.991428 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd55bcc-42e0-45f9-ad9e-5d7276a5d804-kube-api-access-qsp5m" (OuterVolumeSpecName: "kube-api-access-qsp5m") pod "ccd55bcc-42e0-45f9-ad9e-5d7276a5d804" (UID: "ccd55bcc-42e0-45f9-ad9e-5d7276a5d804"). InnerVolumeSpecName "kube-api-access-qsp5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:20:43.991488 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:43.991436 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f6e28a-57ee-42e6-b72b-ff5a164735ea-kube-api-access-26bpg" (OuterVolumeSpecName: "kube-api-access-26bpg") pod "04f6e28a-57ee-42e6-b72b-ff5a164735ea" (UID: "04f6e28a-57ee-42e6-b72b-ff5a164735ea"). InnerVolumeSpecName "kube-api-access-26bpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:20:44.090185 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.090097 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26bpg\" (UniqueName: \"kubernetes.io/projected/04f6e28a-57ee-42e6-b72b-ff5a164735ea-kube-api-access-26bpg\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:20:44.090185 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.090126 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsp5m\" (UniqueName: \"kubernetes.io/projected/ccd55bcc-42e0-45f9-ad9e-5d7276a5d804-kube-api-access-qsp5m\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:20:44.524050 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.524015 2581 generic.go:356] "Generic (PLEG): container finished" podID="04f6e28a-57ee-42e6-b72b-ff5a164735ea" containerID="789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c" exitCode=0 Jun 11 23:20:44.524536 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.524064 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" Jun 11 23:20:44.524536 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.524102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" event={"ID":"04f6e28a-57ee-42e6-b72b-ff5a164735ea","Type":"ContainerDied","Data":"789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c"} Jun 11 23:20:44.524536 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.524147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mr5fr" event={"ID":"04f6e28a-57ee-42e6-b72b-ff5a164735ea","Type":"ContainerDied","Data":"90e201fc108fabca8a6ad741a7c5b884e25a04cdbc56e04d0d923a3929589805"} Jun 11 23:20:44.524536 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.524171 2581 scope.go:117] "RemoveContainer" containerID="789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c" Jun 11 23:20:44.525344 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.525323 2581 generic.go:356] "Generic (PLEG): container finished" podID="ccd55bcc-42e0-45f9-ad9e-5d7276a5d804" containerID="82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b" exitCode=0 Jun 11 23:20:44.525410 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.525359 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c56dn" Jun 11 23:20:44.525493 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.525404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c56dn" event={"ID":"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804","Type":"ContainerDied","Data":"82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b"} Jun 11 23:20:44.525493 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.525439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c56dn" event={"ID":"ccd55bcc-42e0-45f9-ad9e-5d7276a5d804","Type":"ContainerDied","Data":"5f2a6215bacc2c8116ba8f012d27fc650f377fdeae6b4e2becbd6466e78fee35"} Jun 11 23:20:44.533918 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.533695 2581 scope.go:117] "RemoveContainer" containerID="789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c" Jun 11 23:20:44.534081 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:20:44.534053 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c\": container with ID starting with 789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c not found: ID does not exist" containerID="789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c" Jun 11 23:20:44.534177 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.534091 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c"} err="failed to get container status \"789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c\": rpc error: code = NotFound desc = could not find container \"789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c\": container with ID starting with 789a1a5c154d6c7615a33d74ee5615e5610f545a755aae2ce4f0a56d0894438c not found: ID does not exist" Jun 11 23:20:44.534177 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.534114 2581 scope.go:117] "RemoveContainer" containerID="82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b" Jun 11 23:20:44.541409 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.541395 2581 scope.go:117] "RemoveContainer" containerID="82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b" Jun 11 23:20:44.541679 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:20:44.541660 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b\": container with ID starting with 82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b not found: ID does not exist" containerID="82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b" Jun 11 23:20:44.541739 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.541689 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b"} err="failed to get container status \"82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b\": rpc error: code = NotFound desc = could not find container \"82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b\": container with ID starting with 82fe98d1d10c0c492dfa847e9d7dfdf89a117c1602fcd36151791f098813a58b not found: ID does not exist" Jun 11 23:20:44.547775 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.547754 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c56dn"] Jun 11 23:20:44.553425 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.553404 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c56dn"] Jun 11 23:20:44.562949 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.562929 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mr5fr"] Jun 11 23:20:44.566789 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:44.566772 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mr5fr"] Jun 11 23:20:45.570622 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:45.570589 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04f6e28a-57ee-42e6-b72b-ff5a164735ea" path="/var/lib/kubelet/pods/04f6e28a-57ee-42e6-b72b-ff5a164735ea/volumes" Jun 11 23:20:45.570970 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:45.570896 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd55bcc-42e0-45f9-ad9e-5d7276a5d804" path="/var/lib/kubelet/pods/ccd55bcc-42e0-45f9-ad9e-5d7276a5d804/volumes" Jun 11 23:20:47.170026 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.169990 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9549b4fb-jwt24"] Jun 11 23:20:47.170407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.170278 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f6e28a-57ee-42e6-b72b-ff5a164735ea" containerName="authorino" Jun 11 23:20:47.170407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.170289 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f6e28a-57ee-42e6-b72b-ff5a164735ea" containerName="authorino" Jun 11 23:20:47.170407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.170304 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd55bcc-42e0-45f9-ad9e-5d7276a5d804" containerName="authorino" Jun 11 23:20:47.170407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.170309 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd55bcc-42e0-45f9-ad9e-5d7276a5d804" containerName="authorino" Jun 11 23:20:47.170407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.170362 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd55bcc-42e0-45f9-ad9e-5d7276a5d804" containerName="authorino" Jun 11 23:20:47.170407 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.170370 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f6e28a-57ee-42e6-b72b-ff5a164735ea" containerName="authorino" Jun 11 23:20:47.173140 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.173124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:47.182954 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.182937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 23:20:47.183037 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.182936 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ppjwp\"" Jun 11 23:20:47.183557 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.183543 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 23:20:47.192106 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.192084 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9549b4fb-jwt24"] Jun 11 23:20:47.319791 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.319750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6ps\" (UniqueName: \"kubernetes.io/projected/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-kube-api-access-kk6ps\") pod \"maas-controller-7c9549b4fb-jwt24\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:47.319969 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.319812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert\") pod \"maas-controller-7c9549b4fb-jwt24\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:47.365162 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.365120 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-578b9d757-8glkz"] Jun 11 23:20:47.368213 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.368194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.383691 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.383665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-578b9d757-8glkz"] Jun 11 23:20:47.420566 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.420489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6ps\" (UniqueName: \"kubernetes.io/projected/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-kube-api-access-kk6ps\") pod \"maas-controller-7c9549b4fb-jwt24\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:47.420566 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.420551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert\") pod \"maas-controller-7c9549b4fb-jwt24\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:47.420753 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:20:47.420663 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 23:20:47.420753 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:20:47.420733 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert podName:17c0884d-6fa9-4d09-aa4c-d3f029df75d7 nodeName:}" failed. No retries permitted until 2026-06-11 23:20:47.920711096 +0000 UTC m=+798.817177140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert") pod "maas-controller-7c9549b4fb-jwt24" (UID: "17c0884d-6fa9-4d09-aa4c-d3f029df75d7") : secret "maas-controller-webhook-cert" not found Jun 11 23:20:47.445536 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.445495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6ps\" (UniqueName: \"kubernetes.io/projected/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-kube-api-access-kk6ps\") pod \"maas-controller-7c9549b4fb-jwt24\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:47.521414 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.521374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b377a8ad-7f00-48d1-9bfe-aaa4c7854264-webhook-cert\") pod \"maas-controller-578b9d757-8glkz\" (UID: \"b377a8ad-7f00-48d1-9bfe-aaa4c7854264\") " pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.521609 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.521511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v25ds\" (UniqueName: \"kubernetes.io/projected/b377a8ad-7f00-48d1-9bfe-aaa4c7854264-kube-api-access-v25ds\") pod \"maas-controller-578b9d757-8glkz\" (UID: \"b377a8ad-7f00-48d1-9bfe-aaa4c7854264\") " pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.622138 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.622087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v25ds\" (UniqueName: \"kubernetes.io/projected/b377a8ad-7f00-48d1-9bfe-aaa4c7854264-kube-api-access-v25ds\") pod \"maas-controller-578b9d757-8glkz\" (UID: \"b377a8ad-7f00-48d1-9bfe-aaa4c7854264\") " pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.622329 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.622174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b377a8ad-7f00-48d1-9bfe-aaa4c7854264-webhook-cert\") pod \"maas-controller-578b9d757-8glkz\" (UID: \"b377a8ad-7f00-48d1-9bfe-aaa4c7854264\") " pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.624650 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.624629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b377a8ad-7f00-48d1-9bfe-aaa4c7854264-webhook-cert\") pod \"maas-controller-578b9d757-8glkz\" (UID: \"b377a8ad-7f00-48d1-9bfe-aaa4c7854264\") " pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.630828 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.630807 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v25ds\" (UniqueName: \"kubernetes.io/projected/b377a8ad-7f00-48d1-9bfe-aaa4c7854264-kube-api-access-v25ds\") pod \"maas-controller-578b9d757-8glkz\" (UID: \"b377a8ad-7f00-48d1-9bfe-aaa4c7854264\") " pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.678562 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.678489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:47.805600 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.805575 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-578b9d757-8glkz"] Jun 11 23:20:47.807485 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:20:47.807424 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb377a8ad_7f00_48d1_9bfe_aaa4c7854264.slice/crio-7a8dc548709060ebef3fc312e8bed4a36842a3da7574c7f4caddfefbf3667641 WatchSource:0}: Error finding container 7a8dc548709060ebef3fc312e8bed4a36842a3da7574c7f4caddfefbf3667641: Status 404 returned error can't find the container with id 7a8dc548709060ebef3fc312e8bed4a36842a3da7574c7f4caddfefbf3667641 Jun 11 23:20:47.925521 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.925481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert\") pod \"maas-controller-7c9549b4fb-jwt24\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:47.928104 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:47.928074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert\") pod \"maas-controller-7c9549b4fb-jwt24\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:48.083122 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:48.083022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:48.215053 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:48.215024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9549b4fb-jwt24"] Jun 11 23:20:48.216976 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:20:48.216954 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c0884d_6fa9_4d09_aa4c_d3f029df75d7.slice/crio-8b92b290e06dd1e9f7a3d8b2f83fb44246e4c6115f3050a6261386efc5c36b66 WatchSource:0}: Error finding container 8b92b290e06dd1e9f7a3d8b2f83fb44246e4c6115f3050a6261386efc5c36b66: Status 404 returned error can't find the container with id 8b92b290e06dd1e9f7a3d8b2f83fb44246e4c6115f3050a6261386efc5c36b66 Jun 11 23:20:48.546100 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:48.546060 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-578b9d757-8glkz" event={"ID":"b377a8ad-7f00-48d1-9bfe-aaa4c7854264","Type":"ContainerStarted","Data":"7a8dc548709060ebef3fc312e8bed4a36842a3da7574c7f4caddfefbf3667641"} Jun 11 23:20:48.547026 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:48.546997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" event={"ID":"17c0884d-6fa9-4d09-aa4c-d3f029df75d7","Type":"ContainerStarted","Data":"8b92b290e06dd1e9f7a3d8b2f83fb44246e4c6115f3050a6261386efc5c36b66"} Jun 11 23:20:50.557697 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:50.557652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" event={"ID":"17c0884d-6fa9-4d09-aa4c-d3f029df75d7","Type":"ContainerStarted","Data":"182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9"} Jun 11 23:20:50.558169 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:50.557727 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:20:50.559401 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:50.559363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-578b9d757-8glkz" event={"ID":"b377a8ad-7f00-48d1-9bfe-aaa4c7854264","Type":"ContainerStarted","Data":"74905e3b3ccecd1b99550c33a26bc53dfed3effcf143446ff9fddd58fcc49792"} Jun 11 23:20:50.559565 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:50.559466 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:20:50.579919 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:50.579876 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" podStartSLOduration=1.8138653 podStartE2EDuration="3.579860572s" totalImagesPullingTime="1.765995272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:50.578156666 +0000 UTC m=+801.474622746" watchObservedRunningTime="2026-06-11 23:20:50.579860572 +0000 UTC m=+801.476326636" Jun 11 23:20:50.595903 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:20:50.595861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-578b9d757-8glkz" podStartSLOduration=1.416860654 podStartE2EDuration="3.595847307s" totalImagesPullingTime="2.178986653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:50.594269989 +0000 UTC m=+801.490736054" watchObservedRunningTime="2026-06-11 23:20:50.595847307 +0000 UTC m=+801.492313371" Jun 11 23:21:01.571607 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.571571 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-578b9d757-8glkz" Jun 11 23:21:01.572078 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.571643 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:21:01.630377 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.630340 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9549b4fb-jwt24"] Jun 11 23:21:01.630659 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.630624 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" podUID="17c0884d-6fa9-4d09-aa4c-d3f029df75d7" containerName="manager" containerID="cri-o://182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9" gracePeriod=30 Jun 11 23:21:01.872036 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.872010 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:21:01.940543 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.940509 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert\") pod \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " Jun 11 23:21:01.940733 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.940573 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk6ps\" (UniqueName: \"kubernetes.io/projected/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-kube-api-access-kk6ps\") pod \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\" (UID: \"17c0884d-6fa9-4d09-aa4c-d3f029df75d7\") " Jun 11 23:21:01.942857 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.942829 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "17c0884d-6fa9-4d09-aa4c-d3f029df75d7" (UID: "17c0884d-6fa9-4d09-aa4c-d3f029df75d7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:21:01.942952 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:01.942861 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-kube-api-access-kk6ps" (OuterVolumeSpecName: "kube-api-access-kk6ps") pod "17c0884d-6fa9-4d09-aa4c-d3f029df75d7" (UID: "17c0884d-6fa9-4d09-aa4c-d3f029df75d7"). InnerVolumeSpecName "kube-api-access-kk6ps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:21:02.041087 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.041052 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-webhook-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:21:02.041087 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.041079 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk6ps\" (UniqueName: \"kubernetes.io/projected/17c0884d-6fa9-4d09-aa4c-d3f029df75d7-kube-api-access-kk6ps\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:21:02.610561 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.610525 2581 generic.go:356] "Generic (PLEG): container finished" podID="17c0884d-6fa9-4d09-aa4c-d3f029df75d7" containerID="182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9" exitCode=0 Jun 11 23:21:02.610981 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.610573 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" Jun 11 23:21:02.610981 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.610594 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" event={"ID":"17c0884d-6fa9-4d09-aa4c-d3f029df75d7","Type":"ContainerDied","Data":"182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9"} Jun 11 23:21:02.610981 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.610638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9549b4fb-jwt24" event={"ID":"17c0884d-6fa9-4d09-aa4c-d3f029df75d7","Type":"ContainerDied","Data":"8b92b290e06dd1e9f7a3d8b2f83fb44246e4c6115f3050a6261386efc5c36b66"} Jun 11 23:21:02.610981 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.610658 2581 scope.go:117] "RemoveContainer" containerID="182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9" Jun 11 23:21:02.619125 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.619106 2581 scope.go:117] "RemoveContainer" containerID="182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9" Jun 11 23:21:02.619410 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:21:02.619389 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9\": container with ID starting with 182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9 not found: ID does not exist" containerID="182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9" Jun 11 23:21:02.619471 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.619422 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9"} err="failed to get container status \"182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9\": rpc error: code = NotFound desc = could not find container \"182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9\": container with ID starting with 182bb6ea62cc18410408d45ca7d825789a907c715e57907fac83a2db46b3bdc9 not found: ID does not exist" Jun 11 23:21:02.630897 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.630871 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9549b4fb-jwt24"] Jun 11 23:21:02.634919 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:02.634896 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c9549b4fb-jwt24"] Jun 11 23:21:03.571182 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:03.571138 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17c0884d-6fa9-4d09-aa4c-d3f029df75d7" path="/var/lib/kubelet/pods/17c0884d-6fa9-4d09-aa4c-d3f029df75d7/volumes" Jun 11 23:21:13.525252 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:13.525207 2581 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podadaba88f-a5af-4ef7-8a94-44e5ff67debd"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podadaba88f-a5af-4ef7-8a94-44e5ff67debd] : Timed out while waiting for systemd to remove kubepods-besteffort-podadaba88f_a5af_4ef7_8a94_44e5ff67debd.slice" Jun 11 23:21:13.525643 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:21:13.525254 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podadaba88f-a5af-4ef7-8a94-44e5ff67debd] : unable to destroy cgroup paths for cgroup [kubepods besteffort podadaba88f-a5af-4ef7-8a94-44e5ff67debd] : Timed out while waiting for systemd to remove kubepods-besteffort-podadaba88f_a5af_4ef7_8a94_44e5ff67debd.slice" pod="kuadrant-system/authorino-f858794f4-gtqng" podUID="adaba88f-a5af-4ef7-8a94-44e5ff67debd" Jun 11 23:21:13.656961 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:13.656931 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f858794f4-gtqng" Jun 11 23:21:13.684906 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:13.684869 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f858794f4-gtqng"] Jun 11 23:21:13.688887 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:13.688860 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f858794f4-gtqng"] Jun 11 23:21:15.570689 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:15.570657 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adaba88f-a5af-4ef7-8a94-44e5ff67debd" path="/var/lib/kubelet/pods/adaba88f-a5af-4ef7-8a94-44e5ff67debd/volumes" Jun 11 23:21:22.437279 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.437248 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5c5fdb4776-h57fx"] Jun 11 23:21:22.437679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.437576 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17c0884d-6fa9-4d09-aa4c-d3f029df75d7" containerName="manager" Jun 11 23:21:22.437679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.437588 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="17c0884d-6fa9-4d09-aa4c-d3f029df75d7" containerName="manager" Jun 11 23:21:22.437679 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.437661 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="17c0884d-6fa9-4d09-aa4c-d3f029df75d7" containerName="manager" Jun 11 23:21:22.440610 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.440592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.444277 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.444256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bmtt6\"" Jun 11 23:21:22.446223 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.446186 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 23:21:22.453500 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.453476 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5c5fdb4776-h57fx"] Jun 11 23:21:22.503529 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.503481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr9r7\" (UniqueName: \"kubernetes.io/projected/3ecacc0a-c71b-4ceb-b140-e828411377bb-kube-api-access-wr9r7\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.503700 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.503565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ecacc0a-c71b-4ceb-b140-e828411377bb-maas-api-tls\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.503700 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.503591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecacc0a-c71b-4ceb-b140-e828411377bb-openshift-service-ca\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.604547 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.604503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ecacc0a-c71b-4ceb-b140-e828411377bb-maas-api-tls\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.604757 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.604556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecacc0a-c71b-4ceb-b140-e828411377bb-openshift-service-ca\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.604757 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.604601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr9r7\" (UniqueName: \"kubernetes.io/projected/3ecacc0a-c71b-4ceb-b140-e828411377bb-kube-api-access-wr9r7\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.604757 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:21:22.604659 2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 23:21:22.604757 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:21:22.604741 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ecacc0a-c71b-4ceb-b140-e828411377bb-maas-api-tls podName:3ecacc0a-c71b-4ceb-b140-e828411377bb nodeName:}" failed. No retries permitted until 2026-06-11 23:21:23.104719278 +0000 UTC m=+834.001185337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3ecacc0a-c71b-4ceb-b140-e828411377bb-maas-api-tls") pod "maas-api-5c5fdb4776-h57fx" (UID: "3ecacc0a-c71b-4ceb-b140-e828411377bb") : secret "maas-api-serving-cert" not found Jun 11 23:21:22.605277 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.605259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecacc0a-c71b-4ceb-b140-e828411377bb-openshift-service-ca\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.613229 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.613206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr9r7\" (UniqueName: \"kubernetes.io/projected/3ecacc0a-c71b-4ceb-b140-e828411377bb-kube-api-access-wr9r7\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:22.886671 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.886633 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zscrz"] Jun 11 23:21:22.889995 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.889972 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" Jun 11 23:21:22.892427 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.892403 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n6xmh\"" Jun 11 23:21:22.892545 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.892403 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 23:21:22.900937 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:22.900916 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zscrz"] Jun 11 23:21:23.008837 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.008801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8rcv\" (UniqueName: \"kubernetes.io/projected/33597094-6cf2-43e5-8c18-c2b65e25e287-kube-api-access-t8rcv\") pod \"payload-pre-processing-579785bc64-zscrz\" (UID: \"33597094-6cf2-43e5-8c18-c2b65e25e287\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" Jun 11 23:21:23.109608 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.109570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8rcv\" (UniqueName: \"kubernetes.io/projected/33597094-6cf2-43e5-8c18-c2b65e25e287-kube-api-access-t8rcv\") pod \"payload-pre-processing-579785bc64-zscrz\" (UID: \"33597094-6cf2-43e5-8c18-c2b65e25e287\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" Jun 11 23:21:23.109773 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.109677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ecacc0a-c71b-4ceb-b140-e828411377bb-maas-api-tls\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:23.112587 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.112561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ecacc0a-c71b-4ceb-b140-e828411377bb-maas-api-tls\") pod \"maas-api-5c5fdb4776-h57fx\" (UID: \"3ecacc0a-c71b-4ceb-b140-e828411377bb\") " pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:23.117565 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.117545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8rcv\" (UniqueName: \"kubernetes.io/projected/33597094-6cf2-43e5-8c18-c2b65e25e287-kube-api-access-t8rcv\") pod \"payload-pre-processing-579785bc64-zscrz\" (UID: \"33597094-6cf2-43e5-8c18-c2b65e25e287\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" Jun 11 23:21:23.201674 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.201589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" Jun 11 23:21:23.338664 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.338638 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zscrz"] Jun 11 23:21:23.340870 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:21:23.340832 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33597094_6cf2_43e5_8c18_c2b65e25e287.slice/crio-8c86e6a3a01deffa987908f8971b1af77d461902e88bf59d5b69c16839a2f253 WatchSource:0}: Error finding container 8c86e6a3a01deffa987908f8971b1af77d461902e88bf59d5b69c16839a2f253: Status 404 returned error can't find the container with id 8c86e6a3a01deffa987908f8971b1af77d461902e88bf59d5b69c16839a2f253 Jun 11 23:21:23.350992 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.350965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:23.484545 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.484521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5c5fdb4776-h57fx"] Jun 11 23:21:23.487583 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:21:23.487554 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecacc0a_c71b_4ceb_b140_e828411377bb.slice/crio-83abbb8046b60dddddbdc2137cb0f16aeb39525ebe3c2077a4d62ba58b24ccd6 WatchSource:0}: Error finding container 83abbb8046b60dddddbdc2137cb0f16aeb39525ebe3c2077a4d62ba58b24ccd6: Status 404 returned error can't find the container with id 83abbb8046b60dddddbdc2137cb0f16aeb39525ebe3c2077a4d62ba58b24ccd6 Jun 11 23:21:23.705670 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.705620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5c5fdb4776-h57fx" event={"ID":"3ecacc0a-c71b-4ceb-b140-e828411377bb","Type":"ContainerStarted","Data":"83abbb8046b60dddddbdc2137cb0f16aeb39525ebe3c2077a4d62ba58b24ccd6"} Jun 11 23:21:23.707114 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:23.706995 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" event={"ID":"33597094-6cf2-43e5-8c18-c2b65e25e287","Type":"ContainerStarted","Data":"8c86e6a3a01deffa987908f8971b1af77d461902e88bf59d5b69c16839a2f253"} Jun 11 23:21:26.723115 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:26.723072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" event={"ID":"33597094-6cf2-43e5-8c18-c2b65e25e287","Type":"ContainerStarted","Data":"cb23be04b59578ba2798e3d522742ea439bb16ba61dba68091a2a56e3d362c9e"} Jun 11 23:21:26.723787 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:26.723246 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" Jun 11 23:21:26.724715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:26.724687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5c5fdb4776-h57fx" event={"ID":"3ecacc0a-c71b-4ceb-b140-e828411377bb","Type":"ContainerStarted","Data":"c76ad4bba59fc90c0e43f375a9fb90f7878d30d8ca5129e790832f63dcdeefa2"} Jun 11 23:21:26.724835 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:26.724745 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:26.739254 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:26.739206 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" podStartSLOduration=2.3396153650000002 podStartE2EDuration="4.739191341s" totalImagesPullingTime="2.399575976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:21:26.737832302 +0000 UTC m=+837.634298369" watchObservedRunningTime="2026-06-11 23:21:26.739191341 +0000 UTC m=+837.635657405" Jun 11 23:21:26.753080 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:26.753002 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5c5fdb4776-h57fx" podStartSLOduration=2.499794258 podStartE2EDuration="4.752984617s" totalImagesPullingTime="2.253190359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:21:26.752834381 +0000 UTC m=+837.649300478" watchObservedRunningTime="2026-06-11 23:21:26.752984617 +0000 UTC m=+837.649450682" Jun 11 23:21:32.735207 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:32.735180 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5c5fdb4776-h57fx" Jun 11 23:21:37.732045 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:37.731999 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" podUID="33597094-6cf2-43e5-8c18-c2b65e25e287" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.34:9004: connect: connection refused" Jun 11 23:21:47.730625 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:21:47.730586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-zscrz" Jun 11 23:22:29.560215 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:22:29.560182 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:22:29.560993 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:22:29.560973 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:23:36.971053 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:36.971013 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:23:36.971663 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:36.971244 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" containerID="cri-o://220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b" gracePeriod=30 Jun 11 23:23:38.623755 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:38.623724 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:38.676277 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:38.676184 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzc4n\" (UniqueName: \"kubernetes.io/projected/f1d56e26-0530-4ebd-862f-34721b14882f-kube-api-access-nzc4n\") pod \"f1d56e26-0530-4ebd-862f-34721b14882f\" (UID: \"f1d56e26-0530-4ebd-862f-34721b14882f\") " Jun 11 23:23:38.678483 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:38.678433 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d56e26-0530-4ebd-862f-34721b14882f-kube-api-access-nzc4n" (OuterVolumeSpecName: "kube-api-access-nzc4n") pod "f1d56e26-0530-4ebd-862f-34721b14882f" (UID: "f1d56e26-0530-4ebd-862f-34721b14882f"). InnerVolumeSpecName "kube-api-access-nzc4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:23:38.776925 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:38.776896 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzc4n\" (UniqueName: \"kubernetes.io/projected/f1d56e26-0530-4ebd-862f-34721b14882f-kube-api-access-nzc4n\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:23:39.302869 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.302833 2581 generic.go:356] "Generic (PLEG): container finished" podID="f1d56e26-0530-4ebd-862f-34721b14882f" containerID="220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b" exitCode=143 Jun 11 23:23:39.303054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.302881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f1d56e26-0530-4ebd-862f-34721b14882f","Type":"ContainerDied","Data":"220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b"} Jun 11 23:23:39.303054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.302894 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.303054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.302961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f1d56e26-0530-4ebd-862f-34721b14882f","Type":"ContainerDied","Data":"180631d4304c6930b1368e18f28f338533c13e0cd9e03fc849f7006f78dfc8d1"} Jun 11 23:23:39.303054 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.302984 2581 scope.go:117] "RemoveContainer" containerID="220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b" Jun 11 23:23:39.312936 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.312919 2581 scope.go:117] "RemoveContainer" containerID="220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b" Jun 11 23:23:39.313213 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:23:39.313192 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b\": container with ID starting with 220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b not found: ID does not exist" containerID="220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b" Jun 11 23:23:39.313282 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.313222 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b"} err="failed to get container status \"220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b\": rpc error: code = NotFound desc = could not find container \"220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b\": container with ID starting with 220397270c51b43b0dbdad090809c70658900f7baae3c0f5f75cf52ccceb305b not found: ID does not exist" Jun 11 23:23:39.324607 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.324568 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:23:39.329077 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.329055 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:23:39.353602 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.353572 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:23:39.353886 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.353874 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" Jun 11 23:23:39.353928 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.353888 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" Jun 11 23:23:39.353965 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.353940 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" containerName="keycloak" Jun 11 23:23:39.358340 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.358321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.360992 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.360960 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 23:23:39.360992 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.360990 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 23:23:39.361180 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.360989 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 23:23:39.361241 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.361234 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 23:23:39.361293 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.361252 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zg9t5\"" Jun 11 23:23:39.367402 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.367378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:23:39.482328 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.482292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/eb61fe35-c078-466c-a906-9131b8647c81-test-realms\") pod \"maas-keycloak-0\" (UID: \"eb61fe35-c078-466c-a906-9131b8647c81\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.482544 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.482346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5zgt\" (UniqueName: \"kubernetes.io/projected/eb61fe35-c078-466c-a906-9131b8647c81-kube-api-access-r5zgt\") pod \"maas-keycloak-0\" (UID: \"eb61fe35-c078-466c-a906-9131b8647c81\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.571007 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.570928 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d56e26-0530-4ebd-862f-34721b14882f" path="/var/lib/kubelet/pods/f1d56e26-0530-4ebd-862f-34721b14882f/volumes" Jun 11 23:23:39.583498 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.583444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5zgt\" (UniqueName: \"kubernetes.io/projected/eb61fe35-c078-466c-a906-9131b8647c81-kube-api-access-r5zgt\") pod \"maas-keycloak-0\" (UID: \"eb61fe35-c078-466c-a906-9131b8647c81\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.583642 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.583538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/eb61fe35-c078-466c-a906-9131b8647c81-test-realms\") pod \"maas-keycloak-0\" (UID: \"eb61fe35-c078-466c-a906-9131b8647c81\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.584148 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.584130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/eb61fe35-c078-466c-a906-9131b8647c81-test-realms\") pod \"maas-keycloak-0\" (UID: \"eb61fe35-c078-466c-a906-9131b8647c81\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.591785 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.591762 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5zgt\" (UniqueName: \"kubernetes.io/projected/eb61fe35-c078-466c-a906-9131b8647c81-kube-api-access-r5zgt\") pod \"maas-keycloak-0\" (UID: \"eb61fe35-c078-466c-a906-9131b8647c81\") " pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.668369 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.668331 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:39.805829 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:39.805804 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 23:23:39.808574 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:23:39.808549 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb61fe35_c078_466c_a906_9131b8647c81.slice/crio-e53a3cd22a4a5b4a1109fbc75f4af892ce5698d38229a92663e09c04652111aa WatchSource:0}: Error finding container e53a3cd22a4a5b4a1109fbc75f4af892ce5698d38229a92663e09c04652111aa: Status 404 returned error can't find the container with id e53a3cd22a4a5b4a1109fbc75f4af892ce5698d38229a92663e09c04652111aa Jun 11 23:23:40.309902 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:40.309872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eb61fe35-c078-466c-a906-9131b8647c81","Type":"ContainerStarted","Data":"f21f4bd3bf3421b4fcd5518e77a60e5aba3c50b5f34be81dbf29225ec12f23bf"} Jun 11 23:23:40.310056 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:40.309917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eb61fe35-c078-466c-a906-9131b8647c81","Type":"ContainerStarted","Data":"e53a3cd22a4a5b4a1109fbc75f4af892ce5698d38229a92663e09c04652111aa"} Jun 11 23:23:40.328633 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:40.328583 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.908674413 podStartE2EDuration="1.328567071s" totalImagesPullingTime="419.892658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:23:40.328437055 +0000 UTC m=+971.224903120" watchObservedRunningTime="2026-06-11 23:23:40.328567071 +0000 UTC m=+971.225033134" Jun 11 23:23:40.668545 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:40.668505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:40.670317 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:40.670282 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:41.669034 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:41.668991 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:42.669530 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:42.669484 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:43.669715 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:43.669651 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:44.669414 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:44.669358 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:45.669611 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:45.669562 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:46.669538 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:46.669490 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:47.668811 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:47.668764 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:48.668994 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:48.668943 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:49.669418 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:49.669375 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:49.670044 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:49.669997 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:50.669592 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:50.669536 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:51.669605 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:51.669557 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:52.669290 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:52.669237 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 11 23:23:53.794825 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:53.794788 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 23:23:53.811488 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:23:53.811413 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="eb61fe35-c078-466c-a906-9131b8647c81" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:24:03.801341 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:03.801310 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 23:24:14.515257 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.515220 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-568bdf7988-78kds"] Jun 11 23:24:14.519643 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.519620 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.522036 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.522014 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 23:24:14.527928 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.527902 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-568bdf7988-78kds"] Jun 11 23:24:14.610710 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.610671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q966\" (UniqueName: \"kubernetes.io/projected/13a022af-65ce-46b9-b361-06bb7f843c3f-kube-api-access-2q966\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.610888 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.610819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/13a022af-65ce-46b9-b361-06bb7f843c3f-oidc-ca\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.610952 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.610901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13a022af-65ce-46b9-b361-06bb7f843c3f-tls-cert\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.711893 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.711851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13a022af-65ce-46b9-b361-06bb7f843c3f-tls-cert\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.712078 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.711928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q966\" (UniqueName: \"kubernetes.io/projected/13a022af-65ce-46b9-b361-06bb7f843c3f-kube-api-access-2q966\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.712078 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.711981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/13a022af-65ce-46b9-b361-06bb7f843c3f-oidc-ca\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.712719 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.712701 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/13a022af-65ce-46b9-b361-06bb7f843c3f-oidc-ca\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.714525 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.714504 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13a022af-65ce-46b9-b361-06bb7f843c3f-tls-cert\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.721473 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.721427 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q966\" (UniqueName: \"kubernetes.io/projected/13a022af-65ce-46b9-b361-06bb7f843c3f-kube-api-access-2q966\") pod \"authorino-568bdf7988-78kds\" (UID: \"13a022af-65ce-46b9-b361-06bb7f843c3f\") " pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.829369 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.829274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568bdf7988-78kds" Jun 11 23:24:14.963475 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:14.961379 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-568bdf7988-78kds"] Jun 11 23:24:14.966759 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:24:14.966733 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13a022af_65ce_46b9_b361_06bb7f843c3f.slice/crio-4887df2a63ccca8ed724b8be2b284771ca2dab16b1d72e9717effeb4e01a7ec8 WatchSource:0}: Error finding container 4887df2a63ccca8ed724b8be2b284771ca2dab16b1d72e9717effeb4e01a7ec8: Status 404 returned error can't find the container with id 4887df2a63ccca8ed724b8be2b284771ca2dab16b1d72e9717effeb4e01a7ec8 Jun 11 23:24:15.497924 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.497892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-568bdf7988-78kds" event={"ID":"13a022af-65ce-46b9-b361-06bb7f843c3f","Type":"ContainerStarted","Data":"0e13cb717fd7acc28536c7bb9ffc23c2ddd11d71349dd849f3eca69abe0a4ffc"} Jun 11 23:24:15.498082 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.497937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-568bdf7988-78kds" event={"ID":"13a022af-65ce-46b9-b361-06bb7f843c3f","Type":"ContainerStarted","Data":"4887df2a63ccca8ed724b8be2b284771ca2dab16b1d72e9717effeb4e01a7ec8"} Jun 11 23:24:15.516126 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.516072 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-568bdf7988-78kds" podStartSLOduration=1.092015602 podStartE2EDuration="1.516055671s" totalImagesPullingTime="424.040069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:24:15.513191394 +0000 UTC m=+1006.409657458" watchObservedRunningTime="2026-06-11 23:24:15.516055671 +0000 UTC m=+1006.412521728" Jun 11 23:24:15.541238 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.541202 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56747c5c5d-96w8h"] Jun 11 23:24:15.541516 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.541485 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56747c5c5d-96w8h" podUID="6520f553-3af9-40b3-9c4b-c3acbed2f8c4" containerName="authorino" containerID="cri-o://5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e" gracePeriod=30 Jun 11 23:24:15.794552 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.794529 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:24:15.819827 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.819801 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-tls-cert\") pod \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " Jun 11 23:24:15.819957 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.819845 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hksnd\" (UniqueName: \"kubernetes.io/projected/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-kube-api-access-hksnd\") pod \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\" (UID: \"6520f553-3af9-40b3-9c4b-c3acbed2f8c4\") " Jun 11 23:24:15.821958 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.821932 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-kube-api-access-hksnd" (OuterVolumeSpecName: "kube-api-access-hksnd") pod "6520f553-3af9-40b3-9c4b-c3acbed2f8c4" (UID: "6520f553-3af9-40b3-9c4b-c3acbed2f8c4"). InnerVolumeSpecName "kube-api-access-hksnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:24:15.829905 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.829880 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6520f553-3af9-40b3-9c4b-c3acbed2f8c4" (UID: "6520f553-3af9-40b3-9c4b-c3acbed2f8c4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:24:15.920639 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.920564 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hksnd\" (UniqueName: \"kubernetes.io/projected/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-kube-api-access-hksnd\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:24:15.920639 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:15.920590 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6520f553-3af9-40b3-9c4b-c3acbed2f8c4-tls-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\"" Jun 11 23:24:16.503573 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.503533 2581 generic.go:356] "Generic (PLEG): container finished" podID="6520f553-3af9-40b3-9c4b-c3acbed2f8c4" containerID="5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e" exitCode=0 Jun 11 23:24:16.503753 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.503568 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56747c5c5d-96w8h" Jun 11 23:24:16.503753 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.503619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56747c5c5d-96w8h" event={"ID":"6520f553-3af9-40b3-9c4b-c3acbed2f8c4","Type":"ContainerDied","Data":"5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e"} Jun 11 23:24:16.503753 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.503666 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56747c5c5d-96w8h" event={"ID":"6520f553-3af9-40b3-9c4b-c3acbed2f8c4","Type":"ContainerDied","Data":"9920c92c318ae53ab829d8f7a7f134b156f4e9590389c3d25651ad0b39f2ded9"} Jun 11 23:24:16.503753 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.503689 2581 scope.go:117] "RemoveContainer" containerID="5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e" Jun 11 23:24:16.512622 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.512603 2581 scope.go:117] "RemoveContainer" containerID="5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e" Jun 11 23:24:16.512885 ip-10-0-135-254 kubenswrapper[2581]: E0611 23:24:16.512866 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e\": container with ID starting with 5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e not found: ID does not exist" containerID="5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e" Jun 11 23:24:16.512946 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.512898 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e"} err="failed to get container status \"5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e\": rpc error: code = NotFound desc = could not find container \"5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e\": container with ID starting with 5c8a697e10c7a44d6014cea32769f6d7455eee698a1c4c42a8ae1eb20110941e not found: ID does not exist" Jun 11 23:24:16.523443 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.523421 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56747c5c5d-96w8h"] Jun 11 23:24:16.527198 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:16.527176 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56747c5c5d-96w8h"] Jun 11 23:24:17.572576 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:17.572534 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6520f553-3af9-40b3-9c4b-c3acbed2f8c4" path="/var/lib/kubelet/pods/6520f553-3af9-40b3-9c4b-c3acbed2f8c4/volumes" Jun 11 23:24:23.801716 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.801629 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8"] Jun 11 23:24:23.802183 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.802126 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6520f553-3af9-40b3-9c4b-c3acbed2f8c4" containerName="authorino" Jun 11 23:24:23.802183 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.802145 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6520f553-3af9-40b3-9c4b-c3acbed2f8c4" containerName="authorino" Jun 11 23:24:23.802297 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.802232 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6520f553-3af9-40b3-9c4b-c3acbed2f8c4" containerName="authorino" Jun 11 23:24:23.805700 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.805679 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.808271 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.808245 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 23:24:23.808964 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.808939 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 23:24:23.809046 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.808997 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2cp8j\"" Jun 11 23:24:23.809116 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.809073 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 23:24:23.816921 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.816880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8"] Jun 11 23:24:23.884492 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.884420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66fa7c52-2501-4586-b5eb-61578e73c230-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.884673 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.884550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.884673 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.884590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpxpw\" (UniqueName: \"kubernetes.io/projected/66fa7c52-2501-4586-b5eb-61578e73c230-kube-api-access-qpxpw\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.884673 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.884616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.884673 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.884638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.884932 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.884750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985323 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66fa7c52-2501-4586-b5eb-61578e73c230-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985553 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985553 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxpw\" (UniqueName: \"kubernetes.io/projected/66fa7c52-2501-4586-b5eb-61578e73c230-kube-api-access-qpxpw\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985553 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985553 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985553 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985832 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985779 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985832 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.985911 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.985831 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.987891 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.987870 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66fa7c52-2501-4586-b5eb-61578e73c230-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.988185 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.988167 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66fa7c52-2501-4586-b5eb-61578e73c230-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:23.999008 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:23.998979 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpxpw\" (UniqueName: \"kubernetes.io/projected/66fa7c52-2501-4586-b5eb-61578e73c230-kube-api-access-qpxpw\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8\" (UID: \"66fa7c52-2501-4586-b5eb-61578e73c230\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:24.119230 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:24.119195 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:24.260502 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:24.260469 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8"] Jun 11 23:24:24.262863 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:24:24.262838 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fa7c52_2501_4586_b5eb_61578e73c230.slice/crio-a65ac7c7284296957fa1c08eb29ad4e1e08f4ab580f50803ac7c8d75f7c39de1 WatchSource:0}: Error finding container a65ac7c7284296957fa1c08eb29ad4e1e08f4ab580f50803ac7c8d75f7c39de1: Status 404 returned error can't find the container with id a65ac7c7284296957fa1c08eb29ad4e1e08f4ab580f50803ac7c8d75f7c39de1 Jun 11 23:24:24.541036 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:24.540937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" event={"ID":"66fa7c52-2501-4586-b5eb-61578e73c230","Type":"ContainerStarted","Data":"a65ac7c7284296957fa1c08eb29ad4e1e08f4ab580f50803ac7c8d75f7c39de1"} Jun 11 23:24:28.563935 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:28.563901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" event={"ID":"66fa7c52-2501-4586-b5eb-61578e73c230","Type":"ContainerStarted","Data":"7c75a23ad973bbf57010b4a6b26fec96f95b6ecef417832b1c4e60559c09b1c8"} Jun 11 23:24:29.571079 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:29.571048 2581 generic.go:356] "Generic (PLEG): container finished" podID="66fa7c52-2501-4586-b5eb-61578e73c230" containerID="7c75a23ad973bbf57010b4a6b26fec96f95b6ecef417832b1c4e60559c09b1c8" exitCode=0 Jun 11 23:24:29.572469 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:29.572230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" event={"ID":"66fa7c52-2501-4586-b5eb-61578e73c230","Type":"ContainerDied","Data":"7c75a23ad973bbf57010b4a6b26fec96f95b6ecef417832b1c4e60559c09b1c8"} Jun 11 23:24:31.580123 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:31.580088 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" event={"ID":"66fa7c52-2501-4586-b5eb-61578e73c230","Type":"ContainerStarted","Data":"41c6384115f1efb72b4796b816c63a8e7543b3f66066b25cfc742e7857a52e5e"} Jun 11 23:24:31.598640 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:31.598593 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" podStartSLOduration=3.013755363 podStartE2EDuration="8.598570892s" totalImagesPullingTime="4.361167038s" totalInitContainerRuntime="1.223648491s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:24:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:24:31.598265394 +0000 UTC m=+1022.494731459" watchObservedRunningTime="2026-06-11 23:24:31.598570892 +0000 UTC m=+1022.495036956" Jun 11 23:24:34.119557 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:34.119522 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:34.119993 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:34.119588 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:34.132376 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:34.132344 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:24:34.603824 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:24:34.603743 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8" Jun 11 23:25:19.706102 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.706028 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz"] Jun 11 23:25:19.709125 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.709108 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.712525 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.712493 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 23:25:19.723186 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.723162 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz"] Jun 11 23:25:19.765090 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.765064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.765258 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.765093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ead644-6016-4117-bf3e-b4c5a80e209b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.765258 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.765121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.765258 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.765193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nphc\" (UniqueName: \"kubernetes.io/projected/79ead644-6016-4117-bf3e-b4c5a80e209b-kube-api-access-5nphc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.765258 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.765239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.765258 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.765258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866308 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866308 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ead644-6016-4117-bf3e-b4c5a80e209b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866587 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866587 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nphc\" (UniqueName: \"kubernetes.io/projected/79ead644-6016-4117-bf3e-b4c5a80e209b-kube-api-access-5nphc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866587 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866587 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866818 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866706 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866818 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866793 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.866969 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.866945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.868842 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.868821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ead644-6016-4117-bf3e-b4c5a80e209b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.869089 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.869071 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ead644-6016-4117-bf3e-b4c5a80e209b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:19.875545 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:19.875526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nphc\" (UniqueName: \"kubernetes.io/projected/79ead644-6016-4117-bf3e-b4c5a80e209b-kube-api-access-5nphc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz\" (UID: \"79ead644-6016-4117-bf3e-b4c5a80e209b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:20.019602 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:20.019498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:25:20.157196 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:20.157171 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz"] Jun 11 23:25:20.158940 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:25:20.158908 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ead644_6016_4117_bf3e_b4c5a80e209b.slice/crio-3219959b958ea9b218a392b6e6f270fb27ef842a2b227a36bdbb584a4dd54cf8 WatchSource:0}: Error finding container 3219959b958ea9b218a392b6e6f270fb27ef842a2b227a36bdbb584a4dd54cf8: Status 404 returned error can't find the container with id 3219959b958ea9b218a392b6e6f270fb27ef842a2b227a36bdbb584a4dd54cf8 Jun 11 23:25:20.798023 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:20.797990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" event={"ID":"79ead644-6016-4117-bf3e-b4c5a80e209b","Type":"ContainerStarted","Data":"0d055cb3dcee1b89b9eae07da6dacc168d072d5e56ecbe023e369caedd423770"} Jun 11 23:25:20.798389 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:20.798041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" event={"ID":"79ead644-6016-4117-bf3e-b4c5a80e209b","Type":"ContainerStarted","Data":"3219959b958ea9b218a392b6e6f270fb27ef842a2b227a36bdbb584a4dd54cf8"} Jun 11 23:25:35.380749 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.380705 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9"] Jun 11 23:25:35.385698 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.385672 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.388241 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.388215 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 23:25:35.394698 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.394669 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9"] Jun 11 23:25:35.517658 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.517619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.517859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.517709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.517859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.517744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9lt8\" (UniqueName: \"kubernetes.io/projected/10453fae-83a0-461d-9c58-3043af846127-kube-api-access-v9lt8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.517859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.517763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.517859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.517782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.517859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.517840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10453fae-83a0-461d-9c58-3043af846127-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619300 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9lt8\" (UniqueName: \"kubernetes.io/projected/10453fae-83a0-461d-9c58-3043af846127-kube-api-access-v9lt8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619300 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619596 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619596 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10453fae-83a0-461d-9c58-3043af846127-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619596 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619596 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619797 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619834 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619805 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.619882 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.619867 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.621853 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.621829 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10453fae-83a0-461d-9c58-3043af846127-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.622278 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.622256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10453fae-83a0-461d-9c58-3043af846127-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.627954 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.627927 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9lt8\" (UniqueName: \"kubernetes.io/projected/10453fae-83a0-461d-9c58-3043af846127-kube-api-access-v9lt8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-7txd9\" (UID: \"10453fae-83a0-461d-9c58-3043af846127\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.696018 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.695935 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" Jun 11 23:25:35.833138 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.833105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9"] Jun 11 23:25:35.836914 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:25:35.836882 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10453fae_83a0_461d_9c58_3043af846127.slice/crio-8d9e2dc0676b692e8c541d104a271996494cf0db6616748c0e18736dd5a84c93 WatchSource:0}: Error finding container 8d9e2dc0676b692e8c541d104a271996494cf0db6616748c0e18736dd5a84c93: Status 404 returned error can't find the container with id 8d9e2dc0676b692e8c541d104a271996494cf0db6616748c0e18736dd5a84c93 Jun 11 23:25:35.866716 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:35.866687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" event={"ID":"10453fae-83a0-461d-9c58-3043af846127","Type":"ContainerStarted","Data":"8d9e2dc0676b692e8c541d104a271996494cf0db6616748c0e18736dd5a84c93"} Jun 11 23:25:36.872907 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:25:36.872870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-7txd9" event={"ID":"10453fae-83a0-461d-9c58-3043af846127","Type":"ContainerStarted","Data":"5e3938845dde720205ba2e46edcf5702bdfc19193536a9bad6487e8bee829a91"} Jun 11 23:27:05.271652 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:05.271613 2581 generic.go:356] "Generic (PLEG): container finished" podID="79ead644-6016-4117-bf3e-b4c5a80e209b" containerID="0d055cb3dcee1b89b9eae07da6dacc168d072d5e56ecbe023e369caedd423770" exitCode=0 Jun 11 23:27:05.272071 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:05.271684 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" event={"ID":"79ead644-6016-4117-bf3e-b4c5a80e209b","Type":"ContainerDied","Data":"0d055cb3dcee1b89b9eae07da6dacc168d072d5e56ecbe023e369caedd423770"} Jun 11 23:27:05.272297 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:05.272283 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:27:06.277906 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:06.277871 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" event={"ID":"79ead644-6016-4117-bf3e-b4c5a80e209b","Type":"ContainerStarted","Data":"3607cc8bde722e06bc8d5a9bd8ff58aa56f56751e25b2ec634d9291bb26f3b89"} Jun 11 23:27:06.299501 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:06.299433 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" podStartSLOduration=2.142401057 podStartE2EDuration="1m47.299417739s" totalImagesPullingTime="198.10598ms" totalInitContainerRuntime="1m44.958910702s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:27:06.297229792 +0000 UTC m=+1177.193695855" watchObservedRunningTime="2026-06-11 23:27:06.299417739 +0000 UTC m=+1177.195883803" Jun 11 23:27:10.019862 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:10.019823 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:27:10.020268 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:10.019911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:27:10.033067 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:10.033042 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:27:10.306811 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:10.306725 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz" Jun 11 23:27:29.586654 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:29.586625 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:27:29.588720 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:27:29.588699 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:32:19.615441 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:19.615403 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-7txd9_10453fae-83a0-461d-9c58-3043af846127/storage-initializer/0.log" Jun 11 23:32:20.594977 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:20.594950 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-568bdf7988-78kds_13a022af-65ce-46b9-b361-06bb7f843c3f/authorino/0.log" Jun 11 23:32:25.079394 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:25.079360 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dd6984748-fcczv_40f97bb5-2157-4d1b-8180-7d52c120bc11/nginx/0.log" Jun 11 23:32:25.533807 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:25.533775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5c5fdb4776-h57fx_3ecacc0a-c71b-4ceb-b140-e828411377bb/maas-api/0.log" Jun 11 23:32:25.792566 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:25.792480 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-578b9d757-8glkz_b377a8ad-7f00-48d1-9bfe-aaa4c7854264/manager/0.log" Jun 11 23:32:26.402440 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:26.402413 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-j4gg9_6a2d4e09-b88f-4652-b24a-c421dc023209/copy-manifests/0.log" Jun 11 23:32:26.415875 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:26.415845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-j4gg9_6a2d4e09-b88f-4652-b24a-c421dc023209/manager/0.log" Jun 11 23:32:27.815835 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:27.815791 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-568bdf7988-78kds_13a022af-65ce-46b9-b361-06bb7f843c3f/authorino/0.log" Jun 11 23:32:28.043402 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:28.043340 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xv68r_4c1f7fe2-1b9c-433b-97d2-4d2280ca7338/manager/0.log" Jun 11 23:32:28.154564 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:28.154541 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pkzj7_e35ca488-79c4-4984-b7d2-ecf24fdeaf77/kuadrant-console-plugin/0.log" Jun 11 23:32:28.275550 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:28.275525 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xldgq_97848d8c-16d6-43f6-ba98-a37deb042393/registry-server/0.log" Jun 11 23:32:28.396602 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:28.396572 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mvrvm_f21b88e1-95f2-4a3f-91bc-e0be4a2f250c/manager/0.log" Jun 11 23:32:28.625825 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:28.625794 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x6jdz_5a6bb8d6-db62-40b9-baeb-a749c6118e67/manager/0.log" Jun 11 23:32:28.978198 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:28.978124 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vd5mv_1af8320c-7b33-4512-bbee-21cd66191f9d/istio-proxy/0.log" Jun 11 23:32:29.552813 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:29.552786 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zscrz_33597094-6cf2-43e5-8c18-c2b65e25e287/payload-pre-processing/0.log" Jun 11 23:32:29.616395 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:29.616369 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:32:29.617973 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:29.617950 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfgz7_e236869f-8f00-433a-af4d-025a7112d99d/ovn-acl-logging/0.log" Jun 11 23:32:30.144024 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:30.143994 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8_66fa7c52-2501-4586-b5eb-61578e73c230/storage-initializer/0.log" Jun 11 23:32:30.152077 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:30.152053 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-kpmn8_66fa7c52-2501-4586-b5eb-61578e73c230/main/0.log" Jun 11 23:32:30.630528 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:30.630462 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz_79ead644-6016-4117-bf3e-b4c5a80e209b/storage-initializer/0.log" Jun 11 23:32:30.640197 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:30.640177 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-xg7jz_79ead644-6016-4117-bf3e-b4c5a80e209b/main/0.log" Jun 11 23:32:38.299025 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:38.298990 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v54pq_21c80d7a-b6b4-4596-a631-ca2d9023a695/global-pull-secret-syncer/0.log" Jun 11 23:32:38.449546 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:38.449518 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jcgbd_3803699b-9579-4159-9374-ed639ed00c35/konnectivity-agent/0.log" Jun 11 23:32:38.523234 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:38.523202 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-254.ec2.internal_39a67b469fc72ec0b31210c0d3168786/haproxy/0.log" Jun 11 23:32:43.419978 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:43.419857 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-568bdf7988-78kds_13a022af-65ce-46b9-b361-06bb7f843c3f/authorino/0.log" Jun 11 23:32:43.494508 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:43.494483 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xv68r_4c1f7fe2-1b9c-433b-97d2-4d2280ca7338/manager/0.log" Jun 11 23:32:43.522255 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:43.522226 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pkzj7_e35ca488-79c4-4984-b7d2-ecf24fdeaf77/kuadrant-console-plugin/0.log" Jun 11 23:32:43.552302 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:43.552275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xldgq_97848d8c-16d6-43f6-ba98-a37deb042393/registry-server/0.log" Jun 11 23:32:43.581636 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:43.581611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mvrvm_f21b88e1-95f2-4a3f-91bc-e0be4a2f250c/manager/0.log" Jun 11 23:32:43.647925 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:43.647891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x6jdz_5a6bb8d6-db62-40b9-baeb-a749c6118e67/manager/0.log" Jun 11 23:32:45.573891 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:45.573863 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5glcz_c6407658-2efe-4b2c-947b-afd92194696f/node-exporter/0.log" Jun 11 23:32:45.595805 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:45.595783 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5glcz_c6407658-2efe-4b2c-947b-afd92194696f/kube-rbac-proxy/0.log" Jun 11 23:32:45.618650 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:45.618621 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5glcz_c6407658-2efe-4b2c-947b-afd92194696f/init-textfile/0.log" Jun 11 23:32:48.693915 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.693880 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt"] Jun 11 23:32:48.697399 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.697378 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.699621 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.699601 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6m5b\"/\"openshift-service-ca.crt\"" Jun 11 23:32:48.700410 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.700396 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s6m5b\"/\"default-dockercfg-8thfr\"" Jun 11 23:32:48.700510 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.700489 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6m5b\"/\"kube-root-ca.crt\"" Jun 11 23:32:48.708471 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.708427 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt"] Jun 11 23:32:48.870584 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.870552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-sys\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.870584 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.870588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-proc\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.870799 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.870606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p2n2\" (UniqueName: \"kubernetes.io/projected/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-kube-api-access-9p2n2\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.870799 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.870718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-lib-modules\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.870799 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.870744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-podres\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.971959 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.971861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-sys\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.971959 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.971916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-proc\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.971959 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.971937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p2n2\" (UniqueName: \"kubernetes.io/projected/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-kube-api-access-9p2n2\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.972174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.971987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-proc\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.972174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.971986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-sys\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.972174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.972013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-lib-modules\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.972174 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.972143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-podres\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.972305 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.972175 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-lib-modules\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.972305 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.972272 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-podres\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:48.981268 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:48.981244 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p2n2\" (UniqueName: \"kubernetes.io/projected/da4dbdcf-c7ae-4830-95e6-0c94eb012e18-kube-api-access-9p2n2\") pod \"perf-node-gather-daemonset-2gkqt\" (UID: \"da4dbdcf-c7ae-4830-95e6-0c94eb012e18\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:49.007302 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:49.007281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:49.136740 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:49.136661 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt"] Jun 11 23:32:49.139129 ip-10-0-135-254 kubenswrapper[2581]: W0611 23:32:49.139100 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda4dbdcf_c7ae_4830_95e6_0c94eb012e18.slice/crio-c17d9a3520636b20ee7bbf77adbe79fff4706b64d35488dfcb1b32a71d01c416 WatchSource:0}: Error finding container c17d9a3520636b20ee7bbf77adbe79fff4706b64d35488dfcb1b32a71d01c416: Status 404 returned error can't find the container with id c17d9a3520636b20ee7bbf77adbe79fff4706b64d35488dfcb1b32a71d01c416 Jun 11 23:32:49.832923 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:49.832891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" event={"ID":"da4dbdcf-c7ae-4830-95e6-0c94eb012e18","Type":"ContainerStarted","Data":"ad2aa43a5f432da56a8fac7b5132c9ba1af7887005a162d3a06801337821e2f9"} Jun 11 23:32:49.833424 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:49.832938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" event={"ID":"da4dbdcf-c7ae-4830-95e6-0c94eb012e18","Type":"ContainerStarted","Data":"c17d9a3520636b20ee7bbf77adbe79fff4706b64d35488dfcb1b32a71d01c416"} Jun 11 23:32:49.833424 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:49.832969 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:49.850536 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:49.850488 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" podStartSLOduration=1.8504737470000001 podStartE2EDuration="1.850473747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:49.84953593 +0000 UTC m=+1520.746002002" watchObservedRunningTime="2026-06-11 23:32:49.850473747 +0000 UTC m=+1520.746939822" Jun 11 23:32:51.127847 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:51.127817 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgwfn_5d387853-ec92-498d-853f-afde2c823804/dns/0.log" Jun 11 23:32:51.150370 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:51.150345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgwfn_5d387853-ec92-498d-853f-afde2c823804/kube-rbac-proxy/0.log" Jun 11 23:32:51.174859 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:51.174828 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5lf6p_4d75fb5c-1713-4cfd-94bd-9fb67342173a/dns-node-resolver/0.log" Jun 11 23:32:51.770720 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:51.770690 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76648b44c8-lhrx5_350e9555-dca0-4c15-ae52-4845375929b5/registry/0.log" Jun 11 23:32:51.775165 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:51.775136 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76648b44c8-lhrx5_350e9555-dca0-4c15-ae52-4845375929b5/registry/1.log" Jun 11 23:32:51.851668 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:51.851643 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-znj4l_eac0f764-298c-48eb-822e-f46def43a74a/node-ca/0.log" Jun 11 23:32:52.884602 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:52.884572 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vd5mv_1af8320c-7b33-4512-bbee-21cd66191f9d/istio-proxy/0.log" Jun 11 23:32:53.057365 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:53.057336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zscrz_33597094-6cf2-43e5-8c18-c2b65e25e287/payload-pre-processing/0.log" Jun 11 23:32:53.741777 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:53.741748 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tqw5b_1b172de2-3457-48e3-98e0-a01f44d0805e/serve-healthcheck-canary/0.log" Jun 11 23:32:54.269874 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:54.269845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zjgz_600e47e6-01e3-4622-b74c-0e759bcd09b6/kube-rbac-proxy/0.log" Jun 11 23:32:54.292837 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:54.292807 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zjgz_600e47e6-01e3-4622-b74c-0e759bcd09b6/exporter/0.log" Jun 11 23:32:54.315132 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:54.315110 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zjgz_600e47e6-01e3-4622-b74c-0e759bcd09b6/extractor/0.log" Jun 11 23:32:55.848065 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:55.848039 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-2gkqt" Jun 11 23:32:56.688918 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:56.688893 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dd6984748-fcczv_40f97bb5-2157-4d1b-8180-7d52c120bc11/nginx/0.log" Jun 11 23:32:56.798589 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:56.798562 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5c5fdb4776-h57fx_3ecacc0a-c71b-4ceb-b140-e828411377bb/maas-api/0.log" Jun 11 23:32:56.850347 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:56.850320 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-578b9d757-8glkz_b377a8ad-7f00-48d1-9bfe-aaa4c7854264/manager/0.log" Jun 11 23:32:57.086216 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:57.086127 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-j4gg9_6a2d4e09-b88f-4652-b24a-c421dc023209/manager/0.log" Jun 11 23:32:57.104137 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:57.104112 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-j4gg9_6a2d4e09-b88f-4652-b24a-c421dc023209/copy-manifests/0.log" Jun 11 23:32:58.697173 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:32:58.697143 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d6c54dcf4-gn756_0527d32f-aaaa-4080-b33c-3d43886199dd/manager/0.log" Jun 11 23:33:03.068406 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:03.068376 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vd5mv_1af8320c-7b33-4512-bbee-21cd66191f9d/istio-proxy/0.log" Jun 11 23:33:03.178898 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:03.178856 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zscrz_33597094-6cf2-43e5-8c18-c2b65e25e287/payload-pre-processing/0.log" Jun 11 23:33:04.348179 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:04.348151 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vd5mv_1af8320c-7b33-4512-bbee-21cd66191f9d/istio-proxy/0.log" Jun 11 23:33:04.463597 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:04.463569 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zscrz_33597094-6cf2-43e5-8c18-c2b65e25e287/payload-pre-processing/0.log" Jun 11 23:33:06.109188 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.109153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795vd5mv_1af8320c-7b33-4512-bbee-21cd66191f9d/istio-proxy/0.log" Jun 11 23:33:06.128186 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.128162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvwj8_69030a61-4820-4cbc-b2af-24cf40f5a6a5/kube-multus-additional-cni-plugins/0.log" Jun 11 23:33:06.153919 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.153896 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvwj8_69030a61-4820-4cbc-b2af-24cf40f5a6a5/egress-router-binary-copy/0.log" Jun 11 23:33:06.174160 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.174133 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvwj8_69030a61-4820-4cbc-b2af-24cf40f5a6a5/cni-plugins/0.log" Jun 11 23:33:06.195140 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.195119 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvwj8_69030a61-4820-4cbc-b2af-24cf40f5a6a5/bond-cni-plugin/0.log" Jun 11 23:33:06.218298 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.218271 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zscrz_33597094-6cf2-43e5-8c18-c2b65e25e287/payload-pre-processing/0.log" Jun 11 23:33:06.218502 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.218487 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvwj8_69030a61-4820-4cbc-b2af-24cf40f5a6a5/routeoverride-cni/0.log" Jun 11 23:33:06.240617 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.240592 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvwj8_69030a61-4820-4cbc-b2af-24cf40f5a6a5/whereabouts-cni-bincopy/0.log" Jun 11 23:33:06.266164 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.266134 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvwj8_69030a61-4820-4cbc-b2af-24cf40f5a6a5/whereabouts-cni/0.log" Jun 11 23:33:06.301909 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.301883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fpc67_5dcf1664-9e8a-4555-a787-6b709f4e8cd0/kube-multus/0.log" Jun 11 23:33:06.395482 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.395377 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ggh42_811ee76d-d3b7-4790-ab1d-e3cdde50e3b1/network-metrics-daemon/0.log" Jun 11 23:33:06.419557 ip-10-0-135-254 kubenswrapper[2581]: I0611 23:33:06.419532 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ggh42_811ee76d-d3b7-4790-ab1d-e3cdde50e3b1/kube-rbac-proxy/0.log"