Jun 03 19:40:41.578999 ip-10-0-140-247 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:40:41.945816 ip-10-0-140-247 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:40:41.945816 ip-10-0-140-247 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:40:41.945816 ip-10-0-140-247 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:40:41.945816 ip-10-0-140-247 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:40:41.945816 ip-10-0-140-247 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:40:41.946985 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.946600 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:40:41.951232 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951215 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:40:41.951232 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951232 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951236 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951239 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951242 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951245 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951257 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951260 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951263 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951265 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951268 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951271 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951273 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951276 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951279 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951281 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951284 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951286 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951289 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951291 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:40:41.951294 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951297 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951300 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951304 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951307 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951311 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951314 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951316 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951319 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951322 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951324 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951327 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951329 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951332 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951335 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951338 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951341 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951344 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951346 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951349 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951354 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:40:41.951776 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951357 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951360 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951362 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951365 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951368 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951370 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951373 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951375 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951377 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951380 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951382 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951386 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951390 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951392 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951396 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951401 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951404 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951407 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951410 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:40:41.952259 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951413 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951415 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951418 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951421 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951423 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951426 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951429 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951432 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951434 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951437 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951439 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951442 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951444 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951448 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951450 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951453 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951455 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951458 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951461 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951463 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:40:41.952739 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951467 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951469 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951472 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951475 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951477 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951480 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951482 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951485 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951488 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951491 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951493 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951496 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951499 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951502 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951504 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951508 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951511 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951514 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.951517 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:40:41.953251 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952906 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952914 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952918 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952921 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952924 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952927 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952930 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952933 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952936 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952938 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952941 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952944 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952946 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952950 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952952 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952955 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952958 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952960 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952963 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952966 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:40:41.953738 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952969 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952972 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952975 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952978 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952980 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952983 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952986 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952989 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952991 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952994 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952997 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.952999 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953002 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953005 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953007 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953011 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953015 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953018 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953021 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:40:41.954244 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953024 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953027 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953031 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953034 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953036 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953039 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953041 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953044 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953047 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953050 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953052 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953055 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953057 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953060 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953063 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953065 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953068 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953072 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953075 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:40:41.954719 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953078 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953081 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953084 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953087 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953090 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953093 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953095 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953098 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953102 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953104 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953111 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953113 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953116 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953119 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953121 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953124 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953127 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953132 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953135 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953138 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:40:41.955180 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953140 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953143 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953145 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953148 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953151 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953153 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953156 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953158 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953161 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953164 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953166 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953169 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953172 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953174 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953177 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953179 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953182 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953185 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953187 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953190 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:40:41.955712 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953570 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953577 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953581 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953584 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953587 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953590 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953593 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953596 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953598 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953601 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953604 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953606 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953609 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953612 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953614 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953617 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953619 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953622 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953624 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953627 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:40:41.956216 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953629 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953632 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953634 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953637 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953639 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953642 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953644 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953647 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953649 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953652 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953655 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953657 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953660 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953663 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953666 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953669 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953671 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953692 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953696 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:40:41.956709 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953699 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953704 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953707 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953710 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953713 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953716 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953718 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953721 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953723 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953726 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953729 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953731 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953734 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953736 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953739 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953742 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953745 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953748 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953751 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:40:41.957173 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953753 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953756 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953759 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953761 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953764 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953766 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953769 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953773 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953777 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953780 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953784 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953788 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953790 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953793 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953797 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953800 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953802 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953805 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:40:41.957639 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953807 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953810 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953813 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953815 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953818 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953820 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953823 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953825 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953829 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953831 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953834 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953836 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953839 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953843 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953846 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953848 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953851 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953853 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953856 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953859 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:40:41.958151 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953861 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.953864 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953945 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953965 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953973 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953978 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953982 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953985 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953990 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953995 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.953999 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954002 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954006 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954009 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954012 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954015 2562 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954018 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954021 2562 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954025 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954028 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954032 2562 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954034 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954038 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954041 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:40:41.958652 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954044 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954053 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954056 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954059 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954062 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954065 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954068 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954071 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954074 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954079 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954083 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954086 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954089 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954092 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954095 2562 flags.go:64] FLAG: --enable-server="true" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954098 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954103 2562 flags.go:64] FLAG: --event-burst="100" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954106 2562 flags.go:64] FLAG: --event-qps="50" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954109 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954115 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954118 2562 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954122 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954125 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954128 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954131 2562 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:40:41.959250 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954133 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954136 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954139 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954142 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954145 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954147 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954150 2562 flags.go:64] FLAG: --feature-gates="" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954154 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954158 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954161 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954164 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954167 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954170 2562 flags.go:64] FLAG: --help="false" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954173 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-140-247.ec2.internal" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954176 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954179 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954183 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954186 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954190 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954193 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954195 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954198 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954201 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:40:41.959886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954204 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954207 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954210 2562 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954213 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954216 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954219 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954223 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954225 2562 flags.go:64] FLAG: --lock-file="" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954228 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954231 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954234 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954240 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954242 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954245 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954249 2562 flags.go:64] FLAG: --logging-format="text" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954252 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954255 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954260 2562 flags.go:64] FLAG: --manifest-url="" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954262 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954267 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954270 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954273 2562 flags.go:64] FLAG: --max-pods="110" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954276 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954279 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954282 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:40:41.960504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954287 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954290 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954293 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954296 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954302 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954305 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954308 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954311 2562 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954314 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954320 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954322 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954326 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954329 2562 flags.go:64] FLAG: --port="10250" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954333 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954335 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f0bc5846075bd066" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954339 2562 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954342 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954345 2562 flags.go:64] FLAG: --register-node="true" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954347 2562 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954351 2562 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954354 2562 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954357 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954359 2562 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954363 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954368 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:40:41.961123 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954371 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954374 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954377 2562 flags.go:64] FLAG: --runonce="false" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954380 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954383 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954386 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954389 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954392 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954396 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954399 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954402 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954405 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954408 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954411 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954414 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954416 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954419 2562 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954422 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954427 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954430 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954434 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954437 2562 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954440 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954443 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954446 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:40:41.961747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954448 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954451 2562 flags.go:64] FLAG: --v="2" Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954455 2562 flags.go:64] FLAG: --version="false" Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954459 2562 flags.go:64] FLAG: --vmodule="" Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954462 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.954465 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954602 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954606 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954609 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954612 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954615 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954618 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954620 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954623 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954627 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954631 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954634 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954636 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954639 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954641 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954644 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:40:41.962622 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954647 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954650 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954653 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954657 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954660 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954663 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954665 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954668 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954671 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954686 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954689 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954692 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954694 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954697 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954700 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954702 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954705 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954711 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954715 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:40:41.963308 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954718 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954722 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954725 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954728 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954731 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954734 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954737 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954741 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954744 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954747 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954749 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954752 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954754 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954757 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954759 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954762 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954765 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954767 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954770 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954773 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:40:41.963805 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954775 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954778 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954781 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954783 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954786 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954788 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954791 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954794 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954796 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954799 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954804 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954807 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954809 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954812 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954815 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954818 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954820 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954823 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954826 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:40:41.964305 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954830 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954833 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954835 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954838 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954841 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954843 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954846 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954848 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954851 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954854 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954856 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954859 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954861 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954864 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954867 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954870 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954872 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954875 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954878 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954880 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:40:41.964786 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954882 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954885 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954887 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954890 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.954893 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.955593 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.963355 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.963370 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.963390 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.963400 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963456 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963462 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963465 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963469 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:40:41.965287 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963472 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963475 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963478 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963482 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963484 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963487 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963490 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963492 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963495 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963498 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963501 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963504 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963507 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963509 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963512 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963515 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963517 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963520 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963522 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963525 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:40:41.965644 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963528 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963531 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963533 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963536 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963539 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963542 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963545 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963548 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963551 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963553 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963556 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963558 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963561 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963564 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963566 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963569 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963571 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963574 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963576 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:40:41.966132 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963579 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963582 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963584 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963588 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963590 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963593 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963595 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963598 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963602 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963605 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963608 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963611 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963613 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963618 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963621 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963624 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963627 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963629 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963633 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963636 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:40:41.966605 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963638 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963641 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963644 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963646 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963649 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963651 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963654 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963657 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963659 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963662 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963664 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963667 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963670 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963672 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963692 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963698 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963704 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963708 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963711 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:40:41.967149 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963714 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963716 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963719 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963722 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963725 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963727 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963730 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963756 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963760 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963763 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963766 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963771 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963774 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963776 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963779 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:40:41.967628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963782 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.963787 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963901 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963907 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963911 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963914 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963917 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963920 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963923 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963926 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963928 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963931 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963934 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963936 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963939 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:40:41.968053 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963942 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963944 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963947 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963950 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963952 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963955 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963957 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963960 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963962 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963965 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963968 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963970 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963973 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963976 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963979 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963981 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963984 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963986 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963989 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963992 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:40:41.968453 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963994 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963997 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.963999 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964002 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964004 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964007 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964010 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964012 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964015 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964017 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964020 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964022 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964025 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964028 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964030 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964033 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964036 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964038 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964041 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:40:41.968951 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964043 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964045 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964048 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964050 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964053 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964056 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964059 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964062 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964066 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964070 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964073 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964075 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964078 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964081 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964083 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964086 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964088 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964091 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964093 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964096 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:40:41.969417 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964098 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964101 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964104 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964106 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964109 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964112 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964114 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964118 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964120 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964123 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964125 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964128 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964130 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964133 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964135 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964138 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964140 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964145 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964148 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:40:41.969947 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964151 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964154 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964157 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964160 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964162 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964165 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:41.964169 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.964174 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.964277 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.966183 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.967406 2562 server.go:1019] "Starting client certificate rotation" Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.967501 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.967535 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:40:41.970423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.969536 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:40:41.973644 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.973626 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:40:41.983027 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.983011 2562 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:40:41.985655 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.985639 2562 log.go:25] "Validated CRI v1 image API" Jun 03 19:40:41.987037 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.987023 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:40:41.990297 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.990280 2562 fs.go:135] Filesystem UUIDs: map[77f5f47c-725f-4466-b55f-ee55d8a9cd1c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9a99b8ff-ddb7-4be5-9ba4-54e256aad0ad:/dev/nvme0n1p4] Jun 03 19:40:41.990346 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.990297 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:40:41.996300 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.996191 2562 manager.go:216] Machine: {Timestamp:2026-06-03 19:40:41.994944741 +0000 UTC m=+0.305102007 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095337 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e586554f78077ca321ce9144aaa34 SystemUUID:ec2e5865-54f7-8077-ca32-1ce9144aaa34 BootID:47df32b9-97a7-4079-94be-d2f718361234 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:52:a7:64:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:52:a7:64:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:97:f0:7b:ae:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:40:41.996300 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.996296 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:40:41.996411 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.996370 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:40:41.997833 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.997818 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:40:41.998793 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.998772 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:40:41.998949 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.998797 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:40:41.999422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.999413 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:40:41.999453 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.999424 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:40:41.999453 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.999431 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:40:41.999979 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:41.999968 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:40:42.001017 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.001007 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:40:42.003499 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.003488 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:40:42.003607 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.003598 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:40:42.003637 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.003625 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:40:42.003637 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.003635 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:40:42.003730 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.003646 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:40:42.003730 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.003656 2562 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:40:42.003730 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.003664 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:40:42.004023 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.004009 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:40:42.004083 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.004027 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:40:42.006293 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.006263 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:40:42.007880 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.007860 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:40:42.007950 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.007892 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:40:42.009399 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009386 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:40:42.009439 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009408 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:40:42.009439 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009417 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:40:42.009439 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009422 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:40:42.009439 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009432 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:40:42.009439 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009437 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:40:42.009569 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009445 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:40:42.009569 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009450 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:40:42.009569 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009458 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:40:42.009569 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009463 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:40:42.009569 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009472 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:40:42.009569 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.009478 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:40:42.010135 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.010126 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:40:42.010135 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.010135 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:40:42.013228 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.013214 2562 server.go:1268] "Started kubelet" Jun 03 19:40:42.013345 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.013302 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:40:42.013401 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.013379 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:40:42.013401 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.013344 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:40:42.014068 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.014046 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:40:42.014170 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.014149 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:40:42.014241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.014212 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:40:42.014318 ip-10-0-140-247 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:40:42.014725 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.014509 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:40:42.015201 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.015180 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:40:42.018545 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.017788 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-247.ec2.internal.18b5a98af738ed03 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-247.ec2.internal,UID:ip-10-0-140-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-247.ec2.internal,},FirstTimestamp:2026-06-03 19:40:42.013183235 +0000 UTC m=+0.323340479,LastTimestamp:2026-06-03 19:40:42.013183235 +0000 UTC m=+0.323340479,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-247.ec2.internal,}" Jun 03 19:40:42.018689 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.018655 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:40:42.018689 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.018669 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:40:42.018867 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.018847 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.019203 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019172 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:40:42.019203 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019193 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:40:42.019322 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019311 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:40:42.019371 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019324 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:40:42.019485 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019467 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:40:42.019605 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019538 2562 factory.go:55] Registering systemd factory Jun 03 19:40:42.019720 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019609 2562 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:40:42.019864 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019848 2562 factory.go:153] Registering CRI-O factory Jun 03 19:40:42.019929 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019866 2562 factory.go:223] Registration of the crio container factory successfully Jun 03 19:40:42.019990 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019943 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:40:42.019990 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019968 2562 factory.go:103] Registering Raw factory Jun 03 19:40:42.019990 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.019982 2562 manager.go:1196] Started watching for new ooms in manager Jun 03 19:40:42.020174 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.020156 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:40:42.020282 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.020267 2562 manager.go:349] Starting recovery of all containers Jun 03 19:40:42.022866 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.022696 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 19:40:42.023213 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.023043 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 19:40:42.031151 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.031133 2562 manager.go:354] Recovery completed Jun 03 19:40:42.036279 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.036267 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:42.041062 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.041032 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:42.041120 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.041074 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:42.041120 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.041086 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:42.041615 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.041601 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:40:42.041615 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.041614 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:42.041736 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.041616 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:40:42.041736 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.041706 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:40:42.042514 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.042498 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:42.042595 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.042529 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:42.042595 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.042544 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:42.042766 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.042669 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-247.ec2.internal.18b5a98af8e250be default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-247.ec2.internal,UID:ip-10-0-140-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-247.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-247.ec2.internal,},FirstTimestamp:2026-06-03 19:40:42.041061566 +0000 UTC m=+0.351218811,LastTimestamp:2026-06-03 19:40:42.041061566 +0000 UTC m=+0.351218811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-247.ec2.internal,}" Jun 03 19:40:42.042855 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.042830 2562 policy_none.go:49] "None policy: Start" Jun 03 19:40:42.042855 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.042843 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:40:42.042919 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.042857 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:40:42.043808 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.043796 2562 policy_none.go:47] "Start" Jun 03 19:40:42.051258 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.051237 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hpnj9" Jun 03 19:40:42.053362 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.053298 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-247.ec2.internal.18b5a98af8e2970d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-247.ec2.internal,UID:ip-10-0-140-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-247.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-247.ec2.internal,},FirstTimestamp:2026-06-03 19:40:42.041079565 +0000 UTC m=+0.351236807,LastTimestamp:2026-06-03 19:40:42.041079565 +0000 UTC m=+0.351236807,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-247.ec2.internal,}" Jun 03 19:40:42.059896 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.059879 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hpnj9" Jun 03 19:40:42.084350 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.084319 2562 manager.go:337] "Starting Device Plugin manager" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.084375 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.084388 2562 server.go:87] "Starting device plugin registration server" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.084667 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.084703 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.084802 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.084882 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.084891 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.085451 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:40:42.090802 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.085506 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.091084 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.090984 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:40:42.092073 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.092059 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:40:42.092128 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.092094 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:40:42.092128 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.092113 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:40:42.092193 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.092144 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:40:42.094657 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.094630 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:40:42.185375 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.185342 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:42.186281 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.186262 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:42.186378 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.186291 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:42.186378 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.186303 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:42.186378 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.186329 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.193160 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.193120 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal"] Jun 03 19:40:42.193253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.193211 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:42.194629 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.194615 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:42.194715 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.194641 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:42.194715 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.194652 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:42.195851 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.195805 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.195851 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.195832 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-247.ec2.internal\": node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.195963 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.195901 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:42.196033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.196158 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196046 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:42.196729 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196712 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:42.196814 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196741 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:42.196814 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196756 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:42.196814 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196754 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:42.196963 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196850 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:42.196963 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.196868 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:42.198031 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.198013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.198112 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.198045 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:42.198767 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.198752 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:42.198847 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.198776 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:42.198847 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.198790 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:42.221339 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.221306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed50c257e10c91199877ba47b983ec8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal\" (UID: \"ed50c257e10c91199877ba47b983ec8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.221456 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.221342 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-247.ec2.internal\" not found" node="ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.221456 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.221346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed50c257e10c91199877ba47b983ec8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal\" (UID: \"ed50c257e10c91199877ba47b983ec8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.221456 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.221407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab9a8b1c9bd14a20f0e9b74b8d5a4c0a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-247.ec2.internal\" (UID: \"ab9a8b1c9bd14a20f0e9b74b8d5a4c0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.225501 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.225477 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.225902 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.225888 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-247.ec2.internal\" not found" node="ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.321868 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.321826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed50c257e10c91199877ba47b983ec8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal\" (UID: \"ed50c257e10c91199877ba47b983ec8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.321868 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.321864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed50c257e10c91199877ba47b983ec8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal\" (UID: \"ed50c257e10c91199877ba47b983ec8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.321868 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.321879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab9a8b1c9bd14a20f0e9b74b8d5a4c0a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-247.ec2.internal\" (UID: \"ab9a8b1c9bd14a20f0e9b74b8d5a4c0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.322111 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.321914 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed50c257e10c91199877ba47b983ec8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal\" (UID: \"ed50c257e10c91199877ba47b983ec8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.322111 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.321925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed50c257e10c91199877ba47b983ec8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal\" (UID: \"ed50c257e10c91199877ba47b983ec8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.322111 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.321961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab9a8b1c9bd14a20f0e9b74b8d5a4c0a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-247.ec2.internal\" (UID: \"ab9a8b1c9bd14a20f0e9b74b8d5a4c0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.325941 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.325925 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.426036 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.425993 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.524822 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.524754 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.526516 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.526491 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.528422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.528238 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" Jun 03 19:40:42.626811 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.626772 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.727313 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.727283 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.827974 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.827901 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.868308 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.868289 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:40:42.928214 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:42.928169 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:42.967360 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.967335 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:40:42.968026 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.967488 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:40:42.968026 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:42.967502 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:40:43.028835 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:43.028812 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:43.062717 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.062665 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:35:42 +0000 UTC" deadline="2028-03-06 17:25:19.624298166 +0000 UTC" Jun 03 19:40:43.062717 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.062711 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15405h44m36.561590966s" Jun 03 19:40:43.079408 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.079350 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:40:43.129447 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:43.129417 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:43.179616 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.179587 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:40:43.181076 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.181051 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:40:43.181183 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.181092 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:40:43.181183 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.181107 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:40:43.197950 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:43.197907 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9a8b1c9bd14a20f0e9b74b8d5a4c0a.slice/crio-faa2bd94e97d6d047656cd6fefbbbc3bcc75da2373de60edf4b235a526fdf14a WatchSource:0}: Error finding container faa2bd94e97d6d047656cd6fefbbbc3bcc75da2373de60edf4b235a526fdf14a: Status 404 returned error can't find the container with id faa2bd94e97d6d047656cd6fefbbbc3bcc75da2373de60edf4b235a526fdf14a Jun 03 19:40:43.198472 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:43.198441 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded50c257e10c91199877ba47b983ec8f.slice/crio-1ce5de368349ff9b3415f19fca1ecc45ffffa67c749be8874956cde0678036ef WatchSource:0}: Error finding container 1ce5de368349ff9b3415f19fca1ecc45ffffa67c749be8874956cde0678036ef: Status 404 returned error can't find the container with id 1ce5de368349ff9b3415f19fca1ecc45ffffa67c749be8874956cde0678036ef Jun 03 19:40:43.203225 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.203210 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:40:43.229809 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:43.229774 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:43.330332 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:43.330266 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:43.430810 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:43.430793 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-247.ec2.internal\" not found" Jun 03 19:40:43.443294 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.443273 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:40:43.519487 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.519456 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" Jun 03 19:40:43.532398 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.532366 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:40:43.533564 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.533551 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" Jun 03 19:40:43.540650 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:43.540631 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:40:44.005078 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.005051 2562 apiserver.go:52] "Watching apiserver" Jun 03 19:40:44.013240 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.013212 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:40:44.013601 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.013579 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-885bc","openshift-network-operator/iptables-alerter-p6crc","kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7","openshift-image-registry/node-ca-665bw","openshift-multus/multus-additional-cni-plugins-5q4fw","openshift-multus/network-metrics-daemon-82bwq","openshift-ovn-kubernetes/ovnkube-node-mwp6r","kube-system/global-pull-secret-syncer-j5wkc","kube-system/konnectivity-agent-wqrkf","openshift-cluster-node-tuning-operator/tuned-t7bs4","openshift-dns/node-resolver-zxqck","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal","openshift-multus/multus-7xpcv"] Jun 03 19:40:44.016161 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.016141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:44.016248 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.016212 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:44.018203 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.018175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.019220 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.019199 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:40:44.020281 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.020260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.020454 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.020437 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:40:44.020686 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.020655 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d9bb9\"" Jun 03 19:40:44.020900 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.020880 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:40:44.022384 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.022360 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:40:44.022480 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.022429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.023115 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.023097 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nrmjr\"" Jun 03 19:40:44.023261 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.023244 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:40:44.023358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.023292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:40:44.023773 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.023755 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:40:44.024777 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.024660 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g6jrp\"" Jun 03 19:40:44.024979 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.024912 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:40:44.024979 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.024933 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:40:44.025161 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.025011 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:40:44.026072 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.026019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.028051 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.027911 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:40:44.028051 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.027997 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:40:44.028204 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.028125 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5k8x6\"" Jun 03 19:40:44.028253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.028241 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:40:44.028487 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.028471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.028941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.028919 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:40:44.030587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.030558 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:40:44.030707 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.030558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxh5k\"" Jun 03 19:40:44.030707 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.030635 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:40:44.030806 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.030740 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.030844 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.030799 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:44.032018 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-daemon-config\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032098 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-multus-certs\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032098 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-kubernetes\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032098 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-lib-modules\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032246 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnhd7\" (UniqueName: \"kubernetes.io/projected/538d41ca-5470-4859-86cb-f4ca6011b034-kube-api-access-lnhd7\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032246 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysctl-d\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032246 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysctl-conf\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032246 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-host\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab75079-dc7d-49d5-9e23-548d638c16f9-cni-binary-copy\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-cni-multus\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-hostroot\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-conf-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4l6b\" (UniqueName: \"kubernetes.io/projected/36186242-9a2e-4793-90ec-518e85baecb3-kube-api-access-j4l6b\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:44.032436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-os-release\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-socket-dir-parent\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-cni-bin\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-systemd\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032535 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-var-lib-kubelet\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/538d41ca-5470-4859-86cb-f4ca6011b034-tmp\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v75nm\" (UniqueName: \"kubernetes.io/projected/fab75079-dc7d-49d5-9e23-548d638c16f9-kube-api-access-v75nm\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysconfig\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-sys\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-k8s-cni-cncf-io\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-etc-kubernetes\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-netns\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.032783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-modprobe-d\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/538d41ca-5470-4859-86cb-f4ca6011b034-etc-tuned\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-kubelet\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-run\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-system-cni-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-cni-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.032971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-cnibin\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.033263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.033032 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.035260 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.035242 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:40:44.035349 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.035307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.035412 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.035383 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:40:44.035464 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.035408 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:40:44.036098 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.036074 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c94tl\"" Jun 03 19:40:44.036481 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.036462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:40:44.037130 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.037109 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:40:44.037610 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.037592 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:40:44.038056 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.038034 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:40:44.039621 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.038450 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:40:44.039621 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.038820 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lspv5\"" Jun 03 19:40:44.039621 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.038918 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:40:44.040808 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.040643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.043174 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.043141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:44.043252 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.043205 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:44.043455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.043435 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:40:44.043546 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.043478 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:40:44.043546 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.043519 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sv6t2\"" Jun 03 19:40:44.045508 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.045489 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.047443 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.047405 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:40:44.047889 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.047782 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:40:44.047979 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.047892 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mfz5x\"" Jun 03 19:40:44.054558 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.054536 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6qvdn" Jun 03 19:40:44.062159 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.062131 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6qvdn" Jun 03 19:40:44.097568 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.097518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" event={"ID":"ab9a8b1c9bd14a20f0e9b74b8d5a4c0a","Type":"ContainerStarted","Data":"faa2bd94e97d6d047656cd6fefbbbc3bcc75da2373de60edf4b235a526fdf14a"} Jun 03 19:40:44.098949 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.098921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" event={"ID":"ed50c257e10c91199877ba47b983ec8f","Type":"ContainerStarted","Data":"1ce5de368349ff9b3415f19fca1ecc45ffffa67c749be8874956cde0678036ef"} Jun 03 19:40:44.107425 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.107402 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:40:44.121287 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.121262 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:40:44.133533 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysctl-d\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.133533 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysctl-conf\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.133533 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-cni-multus\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.133533 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-conf-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-cnibin\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceb4dea7-8538-462d-92c9-3087b9d43c0c-dbus\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133611 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-cni-multus\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4l6b\" (UniqueName: \"kubernetes.io/projected/36186242-9a2e-4793-90ec-518e85baecb3-kube-api-access-j4l6b\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysctl-d\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-var-lib-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-systemd\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-var-lib-kubelet\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-conf-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-kubelet\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-node-log\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.133834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-ovnkube-script-lib\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9pqx\" (UniqueName: \"kubernetes.io/projected/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-kube-api-access-g9pqx\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-etc-kubernetes\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133884 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysctl-conf\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-cni-bin\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-iptables-alerter-script\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-etc-kubernetes\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-systemd\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-socket-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.133997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-var-lib-kubelet\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkgfn\" (UniqueName: \"kubernetes.io/projected/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-kube-api-access-kkgfn\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-kubelet\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-host-slash\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.134444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-os-release\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-kubelet\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.134261 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-run\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.134336 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs podName:36186242-9a2e-4793-90ec-518e85baecb3 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:44.634312643 +0000 UTC m=+2.944469872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs") pod "network-metrics-daemon-82bwq" (UID: "36186242-9a2e-4793-90ec-518e85baecb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-run\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-cni-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-daemon-config\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-multus-certs\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77a7d526-661c-4266-8e77-d74d1961fb46-serviceca\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-cni-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-multus-certs\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kcw7\" (UniqueName: \"kubernetes.io/projected/3216e1d3-d050-41fd-9403-84f7bc40748c-kube-api-access-6kcw7\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trkcc\" (UniqueName: \"kubernetes.io/projected/77a7d526-661c-4266-8e77-d74d1961fb46-kube-api-access-trkcc\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-run-netns\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.135251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9660a7c0-7142-4512-95cf-9bdeffec62a9-konnectivity-ca\") pod \"konnectivity-agent-wqrkf\" (UID: \"9660a7c0-7142-4512-95cf-9bdeffec62a9\") " pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-registration-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-device-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-etc-selinux\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135080 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-daemon-config\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.134875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-host\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab75079-dc7d-49d5-9e23-548d638c16f9-cni-binary-copy\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-hostroot\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-systemd-units\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceb4dea7-8538-462d-92c9-3087b9d43c0c-kubelet-config\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33e570aa-ee54-4f06-acc7-27580e36aea6-hosts-file\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e570aa-ee54-4f06-acc7-27580e36aea6-tmp-dir\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-host\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135479 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-hostroot\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.135941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-os-release\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-socket-dir-parent\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-cni-bin\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-etc-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-env-overrides\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3216e1d3-d050-41fd-9403-84f7bc40748c-ovn-node-metrics-cert\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-sys-fs\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/538d41ca-5470-4859-86cb-f4ca6011b034-tmp\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75nm\" (UniqueName: \"kubernetes.io/projected/fab75079-dc7d-49d5-9e23-548d638c16f9-kube-api-access-v75nm\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77a7d526-661c-4266-8e77-d74d1961fb46-host\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-slash\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysconfig\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-sys\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-sysconfig\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab75079-dc7d-49d5-9e23-548d638c16f9-cni-binary-copy\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135981 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-multus-socket-dir-parent\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.135994 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-os-release\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-sys\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.136732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-k8s-cni-cncf-io\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-var-lib-cni-bin\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-k8s-cni-cncf-io\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9660a7c0-7142-4512-95cf-9bdeffec62a9-agent-certs\") pod \"konnectivity-agent-wqrkf\" (UID: \"9660a7c0-7142-4512-95cf-9bdeffec62a9\") " pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-system-cni-dir\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136168 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4q66\" (UniqueName: \"kubernetes.io/projected/33e570aa-ee54-4f06-acc7-27580e36aea6-kube-api-access-h4q66\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-netns\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-systemd\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-host-run-netns\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-modprobe-d\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/538d41ca-5470-4859-86cb-f4ca6011b034-etc-tuned\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-log-socket\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-cni-netd\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-ovnkube-config\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.137588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-modprobe-d\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-system-cni-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-cnibin\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-ovn\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136563 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-cnibin\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136568 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab75079-dc7d-49d5-9e23-548d638c16f9-system-cni-dir\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt8k7\" (UniqueName: \"kubernetes.io/projected/38eee980-1217-4628-a494-f1fbf53394cf-kube-api-access-zt8k7\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-kubernetes\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-lib-modules\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnhd7\" (UniqueName: \"kubernetes.io/projected/538d41ca-5470-4859-86cb-f4ca6011b034-kube-api-access-lnhd7\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.136973 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-etc-kubernetes\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.138422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.137070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/538d41ca-5470-4859-86cb-f4ca6011b034-lib-modules\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.139423 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.139399 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/538d41ca-5470-4859-86cb-f4ca6011b034-tmp\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.139573 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.139546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/538d41ca-5470-4859-86cb-f4ca6011b034-etc-tuned\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.143414 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.143215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4l6b\" (UniqueName: \"kubernetes.io/projected/36186242-9a2e-4793-90ec-518e85baecb3-kube-api-access-j4l6b\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:44.149767 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.149287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75nm\" (UniqueName: \"kubernetes.io/projected/fab75079-dc7d-49d5-9e23-548d638c16f9-kube-api-access-v75nm\") pod \"multus-7xpcv\" (UID: \"fab75079-dc7d-49d5-9e23-548d638c16f9\") " pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.150602 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.150580 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnhd7\" (UniqueName: \"kubernetes.io/projected/538d41ca-5470-4859-86cb-f4ca6011b034-kube-api-access-lnhd7\") pod \"tuned-t7bs4\" (UID: \"538d41ca-5470-4859-86cb-f4ca6011b034\") " pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.237655 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-ovnkube-script-lib\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.237655 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9pqx\" (UniqueName: \"kubernetes.io/projected/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-kube-api-access-g9pqx\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-cni-bin\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-iptables-alerter-script\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-socket-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkgfn\" (UniqueName: \"kubernetes.io/projected/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-kube-api-access-kkgfn\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-host-slash\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-os-release\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77a7d526-661c-4266-8e77-d74d1961fb46-serviceca\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.237989 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.237983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kcw7\" (UniqueName: \"kubernetes.io/projected/3216e1d3-d050-41fd-9403-84f7bc40748c-kube-api-access-6kcw7\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trkcc\" (UniqueName: \"kubernetes.io/projected/77a7d526-661c-4266-8e77-d74d1961fb46-kube-api-access-trkcc\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-run-netns\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9660a7c0-7142-4512-95cf-9bdeffec62a9-konnectivity-ca\") pod \"konnectivity-agent-wqrkf\" (UID: \"9660a7c0-7142-4512-95cf-9bdeffec62a9\") " pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-registration-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-device-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-etc-selinux\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238239 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-systemd-units\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceb4dea7-8538-462d-92c9-3087b9d43c0c-kubelet-config\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33e570aa-ee54-4f06-acc7-27580e36aea6-hosts-file\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e570aa-ee54-4f06-acc7-27580e36aea6-tmp-dir\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-etc-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-env-overrides\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3216e1d3-d050-41fd-9403-84f7bc40748c-ovn-node-metrics-cert\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-ovnkube-script-lib\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-host-slash\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-sys-fs\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238642 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-cni-bin\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33e570aa-ee54-4f06-acc7-27580e36aea6-hosts-file\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceb4dea7-8538-462d-92c9-3087b9d43c0c-kubelet-config\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238822 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e570aa-ee54-4f06-acc7-27580e36aea6-tmp-dir\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238884 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-sys-fs\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238931 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-etc-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238945 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77a7d526-661c-4266-8e77-d74d1961fb46-serviceca\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.238997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.238967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-run-netns\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-iptables-alerter-script\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-os-release\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-socket-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-env-overrides\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77a7d526-661c-4266-8e77-d74d1961fb46-host\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239355 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-slash\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.239431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-registration-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9660a7c0-7142-4512-95cf-9bdeffec62a9-agent-certs\") pod \"konnectivity-agent-wqrkf\" (UID: \"9660a7c0-7142-4512-95cf-9bdeffec62a9\") " pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-system-cni-dir\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239479 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/38eee980-1217-4628-a494-f1fbf53394cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4q66\" (UniqueName: \"kubernetes.io/projected/33e570aa-ee54-4f06-acc7-27580e36aea6-kube-api-access-h4q66\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-systemd\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239520 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9660a7c0-7142-4512-95cf-9bdeffec62a9-konnectivity-ca\") pod \"konnectivity-agent-wqrkf\" (UID: \"9660a7c0-7142-4512-95cf-9bdeffec62a9\") " pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-systemd-units\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-device-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239613 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-systemd\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.239766 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-etc-selinux\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-slash\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239851 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77a7d526-661c-4266-8e77-d74d1961fb46-host\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-system-cni-dir\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-log-socket\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-cni-netd\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-log-socket\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-ovnkube-config\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-ovn\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-cni-netd\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.239995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt8k7\" (UniqueName: \"kubernetes.io/projected/38eee980-1217-4628-a494-f1fbf53394cf-kube-api-access-zt8k7\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-run-ovn\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-cnibin\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceb4dea7-8538-462d-92c9-3087b9d43c0c-dbus\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38eee980-1217-4628-a494-f1fbf53394cf-cnibin\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.240358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-var-lib-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceb4dea7-8538-462d-92c9-3087b9d43c0c-dbus\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-kubelet\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-node-log\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.240307 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-var-lib-openvswitch\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-node-log\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.240365 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret podName:ceb4dea7-8538-462d-92c9-3087b9d43c0c nodeName:}" failed. No retries permitted until 2026-06-03 19:40:44.74034579 +0000 UTC m=+3.050503037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret") pod "global-pull-secret-syncer-j5wkc" (UID: "ceb4dea7-8538-462d-92c9-3087b9d43c0c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3216e1d3-d050-41fd-9403-84f7bc40748c-host-kubelet\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.241242 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.240379 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3216e1d3-d050-41fd-9403-84f7bc40748c-ovnkube-config\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.241892 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.241871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3216e1d3-d050-41fd-9403-84f7bc40748c-ovn-node-metrics-cert\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.242156 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.242092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9660a7c0-7142-4512-95cf-9bdeffec62a9-agent-certs\") pod \"konnectivity-agent-wqrkf\" (UID: \"9660a7c0-7142-4512-95cf-9bdeffec62a9\") " pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.252161 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.252136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt8k7\" (UniqueName: \"kubernetes.io/projected/38eee980-1217-4628-a494-f1fbf53394cf-kube-api-access-zt8k7\") pod \"multus-additional-cni-plugins-5q4fw\" (UID: \"38eee980-1217-4628-a494-f1fbf53394cf\") " pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.256025 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.255969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4q66\" (UniqueName: \"kubernetes.io/projected/33e570aa-ee54-4f06-acc7-27580e36aea6-kube-api-access-h4q66\") pod \"node-resolver-zxqck\" (UID: \"33e570aa-ee54-4f06-acc7-27580e36aea6\") " pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.257136 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.256852 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:40:44.257136 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.256880 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:40:44.257136 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.256918 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv2bk for pod openshift-network-diagnostics/network-check-target-885bc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:44.257136 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.256981 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk podName:d7d99910-d615-43e7-8201-19bf4b81354e nodeName:}" failed. No retries permitted until 2026-06-03 19:40:44.756962977 +0000 UTC m=+3.067120226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tv2bk" (UniqueName: "kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk") pod "network-check-target-885bc" (UID: "d7d99910-d615-43e7-8201-19bf4b81354e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:44.257407 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.257179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kcw7\" (UniqueName: \"kubernetes.io/projected/3216e1d3-d050-41fd-9403-84f7bc40748c-kube-api-access-6kcw7\") pod \"ovnkube-node-mwp6r\" (UID: \"3216e1d3-d050-41fd-9403-84f7bc40748c\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.259165 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.259123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9pqx\" (UniqueName: \"kubernetes.io/projected/b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab-kube-api-access-g9pqx\") pod \"iptables-alerter-p6crc\" (UID: \"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab\") " pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.260064 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.260020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trkcc\" (UniqueName: \"kubernetes.io/projected/77a7d526-661c-4266-8e77-d74d1961fb46-kube-api-access-trkcc\") pod \"node-ca-665bw\" (UID: \"77a7d526-661c-4266-8e77-d74d1961fb46\") " pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.260285 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.260267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkgfn\" (UniqueName: \"kubernetes.io/projected/b7e1ce34-d19f-4c87-bcab-61ddcaeced60-kube-api-access-kkgfn\") pod \"aws-ebs-csi-driver-node-ff7f7\" (UID: \"b7e1ce34-d19f-4c87-bcab-61ddcaeced60\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.329730 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.329696 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" Jun 03 19:40:44.338645 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.338620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7xpcv" Jun 03 19:40:44.348441 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.348414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" Jun 03 19:40:44.353979 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.353959 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-665bw" Jun 03 19:40:44.362492 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.362471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" Jun 03 19:40:44.370232 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.370207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:40:44.378996 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.378974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6crc" Jun 03 19:40:44.386761 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.386740 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:40:44.392464 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.392447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zxqck" Jun 03 19:40:44.642472 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.642370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:44.642632 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.642536 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:44.642632 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.642622 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs podName:36186242-9a2e-4793-90ec-518e85baecb3 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:45.642596125 +0000 UTC m=+3.952753357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs") pod "network-metrics-daemon-82bwq" (UID: "36186242-9a2e-4793-90ec-518e85baecb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:44.743047 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.743011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:44.743208 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.743132 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:44.743208 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.743201 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret podName:ceb4dea7-8538-462d-92c9-3087b9d43c0c nodeName:}" failed. No retries permitted until 2026-06-03 19:40:45.743186292 +0000 UTC m=+4.053343524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret") pod "global-pull-secret-syncer-j5wkc" (UID: "ceb4dea7-8538-462d-92c9-3087b9d43c0c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:44.843599 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:44.843564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:44.843824 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.843714 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:40:44.843824 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.843741 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:40:44.843824 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.843763 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv2bk for pod openshift-network-diagnostics/network-check-target-885bc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:44.843824 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:44.843819 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk podName:d7d99910-d615-43e7-8201-19bf4b81354e nodeName:}" failed. No retries permitted until 2026-06-03 19:40:45.843803107 +0000 UTC m=+4.153960337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv2bk" (UniqueName: "kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk") pod "network-check-target-885bc" (UID: "d7d99910-d615-43e7-8201-19bf4b81354e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:45.011282 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:45.011203 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:40:45.066458 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:45.066421 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:35:44 +0000 UTC" deadline="2028-03-03 15:41:19.8496848 +0000 UTC" Jun 03 19:40:45.066458 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:45.066449 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15332h0m34.783238439s" Jun 03 19:40:45.231236 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.231005 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3216e1d3_d050_41fd_9403_84f7bc40748c.slice/crio-ac54c037c7dde9ab00776e691e483a724e4a89cada0525f03f80042d0877f08c WatchSource:0}: Error finding container ac54c037c7dde9ab00776e691e483a724e4a89cada0525f03f80042d0877f08c: Status 404 returned error can't find the container with id ac54c037c7dde9ab00776e691e483a724e4a89cada0525f03f80042d0877f08c Jun 03 19:40:45.232205 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.232169 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38eee980_1217_4628_a494_f1fbf53394cf.slice/crio-30922628b9d415b8ec97aef319a8ab17fd73fc3d0e90a48012f3f8b42c2b31e6 WatchSource:0}: Error finding container 30922628b9d415b8ec97aef319a8ab17fd73fc3d0e90a48012f3f8b42c2b31e6: Status 404 returned error can't find the container with id 30922628b9d415b8ec97aef319a8ab17fd73fc3d0e90a48012f3f8b42c2b31e6 Jun 03 19:40:45.233702 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.233661 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab75079_dc7d_49d5_9e23_548d638c16f9.slice/crio-91c3c0e1c3e5afda8f5d6e51fdd518b7eea8dfa8bc4697f21c31581023c1d175 WatchSource:0}: Error finding container 91c3c0e1c3e5afda8f5d6e51fdd518b7eea8dfa8bc4697f21c31581023c1d175: Status 404 returned error can't find the container with id 91c3c0e1c3e5afda8f5d6e51fdd518b7eea8dfa8bc4697f21c31581023c1d175 Jun 03 19:40:45.255409 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.255385 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e1ce34_d19f_4c87_bcab_61ddcaeced60.slice/crio-2c67cdb865d91794f7834d4227b0655dbfd22c8b8dca906046740d5cd54ece8f WatchSource:0}: Error finding container 2c67cdb865d91794f7834d4227b0655dbfd22c8b8dca906046740d5cd54ece8f: Status 404 returned error can't find the container with id 2c67cdb865d91794f7834d4227b0655dbfd22c8b8dca906046740d5cd54ece8f Jun 03 19:40:45.258558 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.258528 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538d41ca_5470_4859_86cb_f4ca6011b034.slice/crio-95a3f4160b5a2cb6e90cfd1347c3388e94bdd4e752b4b46d6594602dfffb738c WatchSource:0}: Error finding container 95a3f4160b5a2cb6e90cfd1347c3388e94bdd4e752b4b46d6594602dfffb738c: Status 404 returned error can't find the container with id 95a3f4160b5a2cb6e90cfd1347c3388e94bdd4e752b4b46d6594602dfffb738c Jun 03 19:40:45.259909 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.259885 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b0f0ee_a03b_48a5_9286_1ec4c8d82eab.slice/crio-9b988e3975499f159074d6717fe4848ea5be4496f7532dd23f06143f20994b82 WatchSource:0}: Error finding container 9b988e3975499f159074d6717fe4848ea5be4496f7532dd23f06143f20994b82: Status 404 returned error can't find the container with id 9b988e3975499f159074d6717fe4848ea5be4496f7532dd23f06143f20994b82 Jun 03 19:40:45.260464 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.260446 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a7d526_661c_4266_8e77_d74d1961fb46.slice/crio-4aac6c8dc6b94bc755b4c16541b5ea5b2829976ab0624635137aaf35c9f7e884 WatchSource:0}: Error finding container 4aac6c8dc6b94bc755b4c16541b5ea5b2829976ab0624635137aaf35c9f7e884: Status 404 returned error can't find the container with id 4aac6c8dc6b94bc755b4c16541b5ea5b2829976ab0624635137aaf35c9f7e884 Jun 03 19:40:45.261276 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.261135 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e570aa_ee54_4f06_acc7_27580e36aea6.slice/crio-81eeafaee1448571bc755e208f50dfa5c7a1d4b1817d5acb69ff3c8e7ec65987 WatchSource:0}: Error finding container 81eeafaee1448571bc755e208f50dfa5c7a1d4b1817d5acb69ff3c8e7ec65987: Status 404 returned error can't find the container with id 81eeafaee1448571bc755e208f50dfa5c7a1d4b1817d5acb69ff3c8e7ec65987 Jun 03 19:40:45.262087 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:40:45.262019 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9660a7c0_7142_4512_95cf_9bdeffec62a9.slice/crio-77d64ba08a9e92d7a6055f159a4472f0985e7154a0282712710560724d560cbf WatchSource:0}: Error finding container 77d64ba08a9e92d7a6055f159a4472f0985e7154a0282712710560724d560cbf: Status 404 returned error can't find the container with id 77d64ba08a9e92d7a6055f159a4472f0985e7154a0282712710560724d560cbf Jun 03 19:40:45.649640 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:45.649599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:45.649801 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.649776 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:45.649876 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.649856 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs podName:36186242-9a2e-4793-90ec-518e85baecb3 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:47.649836463 +0000 UTC m=+5.959993700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs") pod "network-metrics-daemon-82bwq" (UID: "36186242-9a2e-4793-90ec-518e85baecb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:45.750802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:45.750260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:45.750802 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.750458 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:45.750802 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.750528 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret podName:ceb4dea7-8538-462d-92c9-3087b9d43c0c nodeName:}" failed. No retries permitted until 2026-06-03 19:40:47.750509397 +0000 UTC m=+6.060666627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret") pod "global-pull-secret-syncer-j5wkc" (UID: "ceb4dea7-8538-462d-92c9-3087b9d43c0c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:45.851348 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:45.851216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:45.851548 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.851443 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:40:45.851548 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.851464 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:40:45.851548 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.851476 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv2bk for pod openshift-network-diagnostics/network-check-target-885bc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:45.851548 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:45.851536 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk podName:d7d99910-d615-43e7-8201-19bf4b81354e nodeName:}" failed. No retries permitted until 2026-06-03 19:40:47.85151696 +0000 UTC m=+6.161674206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv2bk" (UniqueName: "kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk") pod "network-check-target-885bc" (UID: "d7d99910-d615-43e7-8201-19bf4b81354e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:46.066786 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.066716 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:35:44 +0000 UTC" deadline="2028-03-08 12:36:21.662746682 +0000 UTC" Jun 03 19:40:46.066786 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.066783 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15448h55m35.595968593s" Jun 03 19:40:46.093838 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.093812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:46.093838 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.093829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:46.094039 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:46.093938 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:46.094039 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.094007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:46.094150 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:46.094117 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:46.094294 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:46.094210 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:46.113375 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.113259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6crc" event={"ID":"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab","Type":"ContainerStarted","Data":"9b988e3975499f159074d6717fe4848ea5be4496f7532dd23f06143f20994b82"} Jun 03 19:40:46.116379 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.116351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zxqck" event={"ID":"33e570aa-ee54-4f06-acc7-27580e36aea6","Type":"ContainerStarted","Data":"81eeafaee1448571bc755e208f50dfa5c7a1d4b1817d5acb69ff3c8e7ec65987"} Jun 03 19:40:46.136420 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.136389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" event={"ID":"b7e1ce34-d19f-4c87-bcab-61ddcaeced60","Type":"ContainerStarted","Data":"2c67cdb865d91794f7834d4227b0655dbfd22c8b8dca906046740d5cd54ece8f"} Jun 03 19:40:46.147659 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.147620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7xpcv" event={"ID":"fab75079-dc7d-49d5-9e23-548d638c16f9","Type":"ContainerStarted","Data":"91c3c0e1c3e5afda8f5d6e51fdd518b7eea8dfa8bc4697f21c31581023c1d175"} Jun 03 19:40:46.161828 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.161799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"ac54c037c7dde9ab00776e691e483a724e4a89cada0525f03f80042d0877f08c"} Jun 03 19:40:46.171303 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.171271 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" event={"ID":"ab9a8b1c9bd14a20f0e9b74b8d5a4c0a","Type":"ContainerStarted","Data":"dcf368cd968a9bcb8d983deb96d561b8b9cd1378de2b073169b343b66257a343"} Jun 03 19:40:46.182647 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.182089 2562 generic.go:356] "Generic (PLEG): container finished" podID="ed50c257e10c91199877ba47b983ec8f" containerID="8c628b1f101e6acd0b6f942defae08ad2448f5136daed95a16a0d734cf6a1b1d" exitCode=0 Jun 03 19:40:46.182647 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.182276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" event={"ID":"ed50c257e10c91199877ba47b983ec8f","Type":"ContainerDied","Data":"8c628b1f101e6acd0b6f942defae08ad2448f5136daed95a16a0d734cf6a1b1d"} Jun 03 19:40:46.188352 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.187901 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-247.ec2.internal" podStartSLOduration=3.187884297 podStartE2EDuration="3.187884297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:46.187398609 +0000 UTC m=+4.497555862" watchObservedRunningTime="2026-06-03 19:40:46.187884297 +0000 UTC m=+4.498041549" Jun 03 19:40:46.197670 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.197598 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqrkf" event={"ID":"9660a7c0-7142-4512-95cf-9bdeffec62a9","Type":"ContainerStarted","Data":"77d64ba08a9e92d7a6055f159a4472f0985e7154a0282712710560724d560cbf"} Jun 03 19:40:46.202355 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.202294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-665bw" event={"ID":"77a7d526-661c-4266-8e77-d74d1961fb46","Type":"ContainerStarted","Data":"4aac6c8dc6b94bc755b4c16541b5ea5b2829976ab0624635137aaf35c9f7e884"} Jun 03 19:40:46.215782 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.215669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" event={"ID":"538d41ca-5470-4859-86cb-f4ca6011b034","Type":"ContainerStarted","Data":"95a3f4160b5a2cb6e90cfd1347c3388e94bdd4e752b4b46d6594602dfffb738c"} Jun 03 19:40:46.229524 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:46.229460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerStarted","Data":"30922628b9d415b8ec97aef319a8ab17fd73fc3d0e90a48012f3f8b42c2b31e6"} Jun 03 19:40:47.241768 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:47.241735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" event={"ID":"ed50c257e10c91199877ba47b983ec8f","Type":"ContainerStarted","Data":"03a4f2468f43fda1f08a266bdb78e153d6a128dc928e5c8bf6c26cfcb8e9fa8b"} Jun 03 19:40:47.668800 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:47.668763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:47.668986 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.668913 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:47.668986 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.668979 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs podName:36186242-9a2e-4793-90ec-518e85baecb3 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:51.668959488 +0000 UTC m=+9.979116717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs") pod "network-metrics-daemon-82bwq" (UID: "36186242-9a2e-4793-90ec-518e85baecb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:47.769508 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:47.769471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:47.769714 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.769624 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:47.769714 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.769701 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret podName:ceb4dea7-8538-462d-92c9-3087b9d43c0c nodeName:}" failed. No retries permitted until 2026-06-03 19:40:51.769669182 +0000 UTC m=+10.079826411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret") pod "global-pull-secret-syncer-j5wkc" (UID: "ceb4dea7-8538-462d-92c9-3087b9d43c0c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:47.870752 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:47.870666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:47.870930 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.870865 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:40:47.870930 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.870886 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:40:47.870930 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.870898 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv2bk for pod openshift-network-diagnostics/network-check-target-885bc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:47.871147 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:47.870959 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk podName:d7d99910-d615-43e7-8201-19bf4b81354e nodeName:}" failed. No retries permitted until 2026-06-03 19:40:51.870936797 +0000 UTC m=+10.181094046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv2bk" (UniqueName: "kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk") pod "network-check-target-885bc" (UID: "d7d99910-d615-43e7-8201-19bf4b81354e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:48.093653 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:48.092779 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:48.093653 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:48.092921 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:48.093653 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:48.093289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:48.093653 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:48.093416 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:48.093653 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:48.093475 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:48.093653 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:48.093597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:50.093295 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:50.093166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:50.093295 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:50.093201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:50.093839 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:50.093305 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:50.093839 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:50.093165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:50.093839 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:50.093758 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:50.093989 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:50.093840 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:51.704156 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:51.704028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:51.704608 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.704215 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:51.704608 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.704299 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs podName:36186242-9a2e-4793-90ec-518e85baecb3 nodeName:}" failed. No retries permitted until 2026-06-03 19:40:59.70427747 +0000 UTC m=+18.014434716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs") pod "network-metrics-daemon-82bwq" (UID: "36186242-9a2e-4793-90ec-518e85baecb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:51.805024 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:51.804965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:51.805205 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.805132 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:51.805205 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.805195 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret podName:ceb4dea7-8538-462d-92c9-3087b9d43c0c nodeName:}" failed. No retries permitted until 2026-06-03 19:40:59.805177285 +0000 UTC m=+18.115334527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret") pod "global-pull-secret-syncer-j5wkc" (UID: "ceb4dea7-8538-462d-92c9-3087b9d43c0c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:51.905862 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:51.905771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:51.906040 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.905973 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:40:51.906040 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.905995 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:40:51.906040 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.906006 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv2bk for pod openshift-network-diagnostics/network-check-target-885bc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:51.906192 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:51.906065 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk podName:d7d99910-d615-43e7-8201-19bf4b81354e nodeName:}" failed. No retries permitted until 2026-06-03 19:40:59.906047267 +0000 UTC m=+18.216204510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv2bk" (UniqueName: "kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk") pod "network-check-target-885bc" (UID: "d7d99910-d615-43e7-8201-19bf4b81354e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:52.094248 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:52.094210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:52.094416 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:52.094322 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:52.094416 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:52.094388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:52.094494 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:52.094468 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:52.094528 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:52.094507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:52.094588 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:52.094567 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:54.092705 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:54.092635 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:54.093155 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:54.092642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:54.093155 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:54.092819 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:54.093155 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:54.092838 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:54.093155 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:54.092951 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:54.093155 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:54.093038 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:56.093047 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:56.093014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:56.093479 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:56.093024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:56.093479 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:56.093129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:56.093479 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:56.093124 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:56.093479 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:56.093210 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:56.093479 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:56.093300 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:58.092797 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:58.092758 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:58.093243 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:58.092758 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:58.093243 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:58.092906 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:40:58.093243 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:58.092757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:58.093243 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:58.092979 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:40:58.093243 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:58.093033 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:40:59.767374 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:59.767341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:40:59.767883 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.767507 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:59.767883 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.767591 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs podName:36186242-9a2e-4793-90ec-518e85baecb3 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:15.767569439 +0000 UTC m=+34.077726677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs") pod "network-metrics-daemon-82bwq" (UID: "36186242-9a2e-4793-90ec-518e85baecb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:40:59.868129 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:59.868094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:40:59.868288 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.868267 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:59.868356 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.868345 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret podName:ceb4dea7-8538-462d-92c9-3087b9d43c0c nodeName:}" failed. No retries permitted until 2026-06-03 19:41:15.868324712 +0000 UTC m=+34.178481956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret") pod "global-pull-secret-syncer-j5wkc" (UID: "ceb4dea7-8538-462d-92c9-3087b9d43c0c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:40:59.968980 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:40:59.968941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:40:59.969142 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.969112 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:40:59.969142 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.969133 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:40:59.969259 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.969145 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv2bk for pod openshift-network-diagnostics/network-check-target-885bc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:40:59.969259 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:40:59.969205 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk podName:d7d99910-d615-43e7-8201-19bf4b81354e nodeName:}" failed. No retries permitted until 2026-06-03 19:41:15.969187184 +0000 UTC m=+34.279344426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv2bk" (UniqueName: "kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk") pod "network-check-target-885bc" (UID: "d7d99910-d615-43e7-8201-19bf4b81354e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:41:00.092872 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:00.092827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:00.093058 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:00.092840 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:00.093058 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:00.092955 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:00.093058 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:00.092847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:00.093058 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:00.093017 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:00.093240 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:00.093133 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:02.093711 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:02.093658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:02.094194 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:02.093790 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:02.094194 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:02.093813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:02.094194 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:02.093925 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:02.094194 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:02.093960 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:02.094194 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:02.094030 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:04.092997 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.092652 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:04.093555 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.092652 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:04.093555 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:04.093076 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:04.093555 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:04.093170 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:04.093555 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.092732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:04.093555 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:04.093282 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:04.273169 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.273145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" event={"ID":"538d41ca-5470-4859-86cb-f4ca6011b034","Type":"ContainerStarted","Data":"48560d274d68bcaa5c5b73a245ebfa4acb9785664a286f8d899a6b5bbaa6f1b4"} Jun 03 19:41:04.274589 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.274566 2562 generic.go:356] "Generic (PLEG): container finished" podID="38eee980-1217-4628-a494-f1fbf53394cf" containerID="d3be22d4d7e37c3105f347552a1757ec96e7c71f5b4ea80c910eae3383371543" exitCode=0 Jun 03 19:41:04.274719 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.274642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerDied","Data":"d3be22d4d7e37c3105f347552a1757ec96e7c71f5b4ea80c910eae3383371543"} Jun 03 19:41:04.275966 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.275947 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zxqck" event={"ID":"33e570aa-ee54-4f06-acc7-27580e36aea6","Type":"ContainerStarted","Data":"55889197a4a7a0404f5da0fa7191264dab2e7efca2904b3e40bb9d919b63f9d0"} Jun 03 19:41:04.277361 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.277335 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" event={"ID":"b7e1ce34-d19f-4c87-bcab-61ddcaeced60","Type":"ContainerStarted","Data":"e2418a995f77ba1802b8dbbe195da69f8a5308c0d93b52dd62740a0d46a0be03"} Jun 03 19:41:04.278768 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.278751 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7xpcv" event={"ID":"fab75079-dc7d-49d5-9e23-548d638c16f9","Type":"ContainerStarted","Data":"588d2d3d16c02d172880e0d9b9d044bed7acce3b919cc1a4c0b5fa2644235e5e"} Jun 03 19:41:04.283331 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.283310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"db68663abbbf3dc03800db893a640716cfef6b20de63562453ba59870e906a5a"} Jun 03 19:41:04.283414 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.283383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"68109831f4b815b9798e40140d21734cb7df45e8bf102501ad9b045284a79a17"} Jun 03 19:41:04.283457 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.283434 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"318a9b80ab12c900fa03b170bb42d5254e9d35e8e10398da77efc523c4e3fe9e"} Jun 03 19:41:04.283500 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.283483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"d28a40a4a8799037c1436e339f0db104fa423a8da6e51c28ebb2c153a08a1b44"} Jun 03 19:41:04.283535 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.283526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"2faf8ea6959b42facb000b51954d0f7dd611638d9a2eb195fb8d9602b5540dd0"} Jun 03 19:41:04.284705 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.284662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqrkf" event={"ID":"9660a7c0-7142-4512-95cf-9bdeffec62a9","Type":"ContainerStarted","Data":"2fc0fa08bf3dff5c0171bc423f07016ddc68ee83ad686f8245c652b0fbcf86ed"} Jun 03 19:41:04.286083 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.286038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-665bw" event={"ID":"77a7d526-661c-4266-8e77-d74d1961fb46","Type":"ContainerStarted","Data":"4ee777237709d32c2a6f01b731dfda7338161db59b58a1bc5e0a6d096c22b2ee"} Jun 03 19:41:04.292147 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.292102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t7bs4" podStartSLOduration=3.931650991 podStartE2EDuration="22.292088471s" totalImagesPullingTime="18.36043748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:04.292056496 +0000 UTC m=+22.602213750" watchObservedRunningTime="2026-06-03 19:41:04.292088471 +0000 UTC m=+22.602245724" Jun 03 19:41:04.292273 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.292253 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-247.ec2.internal" podStartSLOduration=21.292247239 podStartE2EDuration="21.292247239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:47.259055646 +0000 UTC m=+5.569212898" watchObservedRunningTime="2026-06-03 19:41:04.292247239 +0000 UTC m=+22.602404487" Jun 03 19:41:04.326986 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.326939 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqrkf" podStartSLOduration=8.060965365 podStartE2EDuration="22.326921982s" totalImagesPullingTime="14.265956617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:04.305993745 +0000 UTC m=+22.616150997" watchObservedRunningTime="2026-06-03 19:41:04.326921982 +0000 UTC m=+22.637079233" Jun 03 19:41:04.327144 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.327082 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zxqck" podStartSLOduration=3.965340083 podStartE2EDuration="22.327076481s" totalImagesPullingTime="18.361736398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:04.326822615 +0000 UTC m=+22.636980038" watchObservedRunningTime="2026-06-03 19:41:04.327076481 +0000 UTC m=+22.637233731" Jun 03 19:41:04.358581 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.358534 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7xpcv" podStartSLOduration=3.9158335490000002 podStartE2EDuration="22.358519568s" totalImagesPullingTime="18.442686019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:04.358421168 +0000 UTC m=+22.668578419" watchObservedRunningTime="2026-06-03 19:41:04.358519568 +0000 UTC m=+22.668676841" Jun 03 19:41:04.375255 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:04.375205 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-665bw" podStartSLOduration=4.035605993 podStartE2EDuration="22.3751892s" totalImagesPullingTime="18.339583207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:04.374863032 +0000 UTC m=+22.685020283" watchObservedRunningTime="2026-06-03 19:41:04.3751892 +0000 UTC m=+22.685346451" Jun 03 19:41:05.289762 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:05.289737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6crc" event={"ID":"b1b0f0ee-a03b-48a5-9286-1ec4c8d82eab","Type":"ContainerStarted","Data":"3234941b299cab614523134f252a3c9eb598789e7357738a0604b8583952bf6a"} Jun 03 19:41:05.292567 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:05.292539 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"b64e1bf94d0bd9bc32a846ba6d159e8be197d435abbc9841fbb2dcfce2b365c3"} Jun 03 19:41:05.304771 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:05.304725 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p6crc" podStartSLOduration=4.9657295470000005 podStartE2EDuration="23.304704838s" totalImagesPullingTime="18.338975291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:05.30461328 +0000 UTC m=+23.614770544" watchObservedRunningTime="2026-06-03 19:41:05.304704838 +0000 UTC m=+23.614862091" Jun 03 19:41:05.320914 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:05.320883 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:41:06.093430 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:06.093208 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:06.093625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:06.093216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:06.093625 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:06.093537 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:06.093625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:06.093216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:06.093625 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:06.093604 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:06.093884 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:06.093724 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:06.095194 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:06.095112 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:41:05.32089907Z","UUID":"d5a50e95-2974-4a52-b028-4d3ee31e376a","Handler":null,"Name":"","Endpoint":""} Jun 03 19:41:06.096729 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:06.096709 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:41:06.096831 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:06.096753 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:41:06.297263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:06.297229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" event={"ID":"b7e1ce34-d19f-4c87-bcab-61ddcaeced60","Type":"ContainerStarted","Data":"584530b2c3b4268495f1d250e46bdfe21234cd6576f0887e5fe2b275324339d7"} Jun 03 19:41:07.305272 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:07.305228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" event={"ID":"b7e1ce34-d19f-4c87-bcab-61ddcaeced60","Type":"ContainerStarted","Data":"d5c3012013f89a93e0a886555916d064a545afe986ba70b3d17acbb542052d84"} Jun 03 19:41:07.308136 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:07.308116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"fe95c9ec52333cfc7a133509ea788dce6cfe65d476d5775318803d416cf3b85e"} Jun 03 19:41:07.780353 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:07.780321 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:41:07.780945 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:07.780915 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:41:07.799886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:07.799837 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff7f7" podStartSLOduration=4.782716304 podStartE2EDuration="25.799818613s" totalImagesPullingTime="21.017102309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:07.325627044 +0000 UTC m=+25.635784294" watchObservedRunningTime="2026-06-03 19:41:07.799818613 +0000 UTC m=+26.109975861" Jun 03 19:41:08.093030 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:08.092995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:08.093228 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:08.092995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:08.093228 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:08.093123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:08.093228 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:08.093149 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:08.093228 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:08.093186 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:08.093450 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:08.093252 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:08.311140 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:08.311111 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:41:08.311799 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:08.311622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqrkf" Jun 03 19:41:10.092663 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.092479 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:10.093189 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.092492 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:10.093189 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:10.092759 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:10.093189 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.092527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:10.093189 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:10.092844 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:10.093189 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:10.092913 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:10.319106 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.319068 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" event={"ID":"3216e1d3-d050-41fd-9403-84f7bc40748c","Type":"ContainerStarted","Data":"f47712c3e8b1023f6733053e555a4c5fbc1605862a4c601ffd4779611d380be1"} Jun 03 19:41:10.319402 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.319187 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:41:10.319402 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.319241 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:41:10.320855 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.320817 2562 generic.go:356] "Generic (PLEG): container finished" podID="38eee980-1217-4628-a494-f1fbf53394cf" containerID="9062c85e9480720098aa3974e96d2bdba1aa4e03c8460e4698deac3ef08f6a11" exitCode=0 Jun 03 19:41:10.320985 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.320898 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerDied","Data":"9062c85e9480720098aa3974e96d2bdba1aa4e03c8460e4698deac3ef08f6a11"} Jun 03 19:41:10.335729 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.335702 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:41:10.346706 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:10.346618 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" podStartSLOduration=9.886047544 podStartE2EDuration="28.34660382s" totalImagesPullingTime="18.460556276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:10.34603796 +0000 UTC m=+28.656195224" watchObservedRunningTime="2026-06-03 19:41:10.34660382 +0000 UTC m=+28.656761117" Jun 03 19:41:11.296817 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.296784 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5wkc"] Jun 03 19:41:11.297335 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.296927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:11.297335 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:11.297047 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:11.299967 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.299942 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-885bc"] Jun 03 19:41:11.300082 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.300041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:11.300156 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:11.300135 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:11.302772 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.302740 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82bwq"] Jun 03 19:41:11.302877 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.302846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:11.302985 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:11.302956 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:11.323336 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.322824 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:41:11.340308 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:11.340288 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:41:12.327008 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:12.326973 2562 generic.go:356] "Generic (PLEG): container finished" podID="38eee980-1217-4628-a494-f1fbf53394cf" containerID="9d969194615e49c715f8b20596ceee8f56f06c1dfdd033c43a3d5b5f86b19d25" exitCode=0 Jun 03 19:41:12.327448 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:12.327012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerDied","Data":"9d969194615e49c715f8b20596ceee8f56f06c1dfdd033c43a3d5b5f86b19d25"} Jun 03 19:41:13.093041 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:13.092884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:13.093231 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:13.092883 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:13.093231 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:13.093114 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:13.093231 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:13.093203 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:13.093231 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:13.092883 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:13.093356 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:13.093293 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:13.332002 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:13.331975 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerStarted","Data":"1bb6560339117c3d070ea43e5b6d185cfa58c74b40f6adde8e8faf4cb766d835"} Jun 03 19:41:14.336515 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:14.336480 2562 generic.go:356] "Generic (PLEG): container finished" podID="38eee980-1217-4628-a494-f1fbf53394cf" containerID="1bb6560339117c3d070ea43e5b6d185cfa58c74b40f6adde8e8faf4cb766d835" exitCode=0 Jun 03 19:41:14.336874 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:14.336524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerDied","Data":"1bb6560339117c3d070ea43e5b6d185cfa58c74b40f6adde8e8faf4cb766d835"} Jun 03 19:41:15.092504 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:15.092469 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:15.092663 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:15.092479 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:15.092663 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.092602 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82bwq" podUID="36186242-9a2e-4793-90ec-518e85baecb3" Jun 03 19:41:15.092788 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:15.092658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:15.092834 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.092787 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-885bc" podUID="d7d99910-d615-43e7-8201-19bf4b81354e" Jun 03 19:41:15.092890 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.092870 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5wkc" podUID="ceb4dea7-8538-462d-92c9-3087b9d43c0c" Jun 03 19:41:15.790923 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:15.790890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:15.791559 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.791054 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:41:15.791559 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.791120 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs podName:36186242-9a2e-4793-90ec-518e85baecb3 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:47.791100899 +0000 UTC m=+66.101258141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs") pod "network-metrics-daemon-82bwq" (UID: "36186242-9a2e-4793-90ec-518e85baecb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:41:15.891505 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:15.891468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:15.891697 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.891661 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:41:15.891781 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.891770 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret podName:ceb4dea7-8538-462d-92c9-3087b9d43c0c nodeName:}" failed. No retries permitted until 2026-06-03 19:41:47.891747333 +0000 UTC m=+66.201904574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret") pod "global-pull-secret-syncer-j5wkc" (UID: "ceb4dea7-8538-462d-92c9-3087b9d43c0c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:41:15.992061 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:15.992029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:15.992236 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.992177 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:41:15.992236 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.992191 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:41:15.992236 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.992200 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv2bk for pod openshift-network-diagnostics/network-check-target-885bc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:41:15.992335 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:15.992251 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk podName:d7d99910-d615-43e7-8201-19bf4b81354e nodeName:}" failed. No retries permitted until 2026-06-03 19:41:47.992237394 +0000 UTC m=+66.302394623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv2bk" (UniqueName: "kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk") pod "network-check-target-885bc" (UID: "d7d99910-d615-43e7-8201-19bf4b81354e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:41:16.504758 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.504633 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-247.ec2.internal" event="NodeReady" Jun 03 19:41:16.504922 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.504820 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:41:16.546930 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.546897 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk"] Jun 03 19:41:16.548726 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.548699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" Jun 03 19:41:16.553585 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.552793 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-p7qjt"] Jun 03 19:41:16.553585 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.552854 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.553585 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.552953 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.553585 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.553000 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n44ft\"" Jun 03 19:41:16.554582 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.554561 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bc994f9d6-srgr6"] Jun 03 19:41:16.554733 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.554716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.556650 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.556633 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-xglz6"] Jun 03 19:41:16.556800 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.556777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.558218 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.558201 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg"] Jun 03 19:41:16.558308 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.558295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:16.559792 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.559772 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z"] Jun 03 19:41:16.559898 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.559883 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:16.561113 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.561095 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9"] Jun 03 19:41:16.561216 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.561120 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 19:41:16.561216 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.561153 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 19:41:16.561216 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.561198 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.562743 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.562727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.563629 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.563604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.564045 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564026 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-p9flq\"" Jun 03 19:41:16.564738 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564522 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:41:16.564738 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 19:41:16.564882 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564741 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zksm4\"" Jun 03 19:41:16.564882 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564833 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 19:41:16.564882 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564873 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.565028 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564936 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:41:16.565028 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.564947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:41:16.566394 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.566369 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nms7s\"" Jun 03 19:41:16.566567 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.566552 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t5dn9\"" Jun 03 19:41:16.566567 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.566560 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.566784 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.566766 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 19:41:16.566908 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.566888 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.566980 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.566946 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.566980 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.566889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 19:41:16.567341 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.567321 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.568296 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.567697 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 19:41:16.568296 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.568286 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fndkw\"" Jun 03 19:41:16.568437 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.568264 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 19:41:16.568437 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.568309 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.568763 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.568744 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gdzjg\"" Jun 03 19:41:16.568897 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.568879 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 19:41:16.568897 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.568891 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.571361 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.571341 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk"] Jun 03 19:41:16.577503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.576579 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-mm7qk"] Jun 03 19:41:16.579278 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.578825 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj"] Jun 03 19:41:16.579278 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.579140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.582850 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.582830 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.583626 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.583607 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 19:41:16.586618 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.584775 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:41:16.586618 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.585521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-p7qjt"] Jun 03 19:41:16.586618 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.585575 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dfc6575cf-lqd8h"] Jun 03 19:41:16.586618 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.585849 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" Jun 03 19:41:16.586953 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.586653 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hkhp6\"" Jun 03 19:41:16.588526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.588505 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.589559 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.588711 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 19:41:16.590308 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.590288 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.590779 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.590716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 19:41:16.591304 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.591287 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5snpv\"" Jun 03 19:41:16.592322 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.592297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.594280 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.594259 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4"] Jun 03 19:41:16.594483 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.594386 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.596059 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.595988 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 19:41:16.596714 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.596640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rn4zh\"" Jun 03 19:41:16.597044 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.597025 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.597299 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.597277 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 19:41:16.597596 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.597577 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 19:41:16.598151 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.597765 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.598398 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.597811 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 19:41:16.598626 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.597926 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.598873 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9"] Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.599407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z"] Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.599447 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc994f9d6-srgr6"] Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.598947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.599469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-xglz6"] Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.599487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj"] Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.599504 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-mm7qk"] Jun 03 19:41:16.599530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.599522 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4"] Jun 03 19:41:16.599973 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.599540 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dfc6575cf-lqd8h"] Jun 03 19:41:16.603635 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.603600 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.603968 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.603944 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.604077 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.603987 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 19:41:16.604167 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.604151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 19:41:16.604260 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.604222 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-plszr\"" Jun 03 19:41:16.604891 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.604870 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg"] Jun 03 19:41:16.606554 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.606504 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zxpgd"] Jun 03 19:41:16.608724 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.608705 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4p8zp"] Jun 03 19:41:16.608942 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.608928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.610790 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.610774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:16.611501 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.611484 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:41:16.611610 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.611577 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vfft\"" Jun 03 19:41:16.611746 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.611625 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:41:16.612941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.612924 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bl6bl\"" Jun 03 19:41:16.613062 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.613042 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:41:16.613186 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.612955 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:41:16.613257 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.612955 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:41:16.616814 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.616792 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4p8zp"] Jun 03 19:41:16.618762 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.618742 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxpgd"] Jun 03 19:41:16.696041 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.695996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc52z\" (UniqueName: \"kubernetes.io/projected/557bfea7-56e5-499e-b18c-440c11f55d9f-kube-api-access-xc52z\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.696041 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.696278 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f463e3a-575a-4f0e-a204-d3a807cdc361-tmp\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.696278 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-trusted-ca\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.696278 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-default-certificate\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.696278 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhw7l\" (UniqueName: \"kubernetes.io/projected/a69dfa68-e1af-466a-ad6c-610762bdcfc0-kube-api-access-bhw7l\") pod \"volume-data-source-validator-78dd696465-c5xfk\" (UID: \"a69dfa68-e1af-466a-ad6c-610762bdcfc0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" Jun 03 19:41:16.696278 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls5k9\" (UniqueName: \"kubernetes.io/projected/a183de41-885c-4a77-9971-470bf0631bbd-kube-api-access-ls5k9\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de7bd1e1-eb10-48e8-9f29-db2235f4f27f-cert\") pod \"ingress-canary-4p8zp\" (UID: \"de7bd1e1-eb10-48e8-9f29-db2235f4f27f\") " pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-bound-sa-token\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc70db4a-592a-4944-9898-17be786a2c21-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f463e3a-575a-4f0e-a204-d3a807cdc361-trusted-ca-bundle\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/557bfea7-56e5-499e-b18c-440c11f55d9f-trusted-ca\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696481 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw89r\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-kube-api-access-kw89r\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.696526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc70db4a-592a-4944-9898-17be786a2c21-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696535 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-stats-auth\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6c421-1794-4d3b-994b-615041274c88-ca-trust-extracted\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5lqf\" (UniqueName: \"kubernetes.io/projected/0f463e3a-575a-4f0e-a204-d3a807cdc361-kube-api-access-w5lqf\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76a35794-56f3-42ab-af30-446edb2934be-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9bn\" (UniqueName: \"kubernetes.io/projected/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-kube-api-access-5p9bn\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k742\" (UniqueName: \"kubernetes.io/projected/7f5d43ce-cfc0-472a-a217-7a6e484feb81-kube-api-access-4k742\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f463e3a-575a-4f0e-a204-d3a807cdc361-serving-cert\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9e4caa0-abb4-42c3-a210-dce9c17caa66-serving-cert\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.696860 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a183de41-885c-4a77-9971-470bf0631bbd-tmp-dir\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-image-registry-private-configuration\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.696982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f463e3a-575a-4f0e-a204-d3a807cdc361-snapshots\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f463e3a-575a-4f0e-a204-d3a807cdc361-service-ca-bundle\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-installation-pull-secrets\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkxk\" (UniqueName: \"kubernetes.io/projected/76a35794-56f3-42ab-af30-446edb2934be-kube-api-access-nzkxk\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-registry-certificates\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/557bfea7-56e5-499e-b18c-440c11f55d9f-config\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31999664-3290-426f-be81-720cc7036299-nginx-conf\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p279h\" (UniqueName: \"kubernetes.io/projected/de7bd1e1-eb10-48e8-9f29-db2235f4f27f-kube-api-access-p279h\") pod \"ingress-canary-4p8zp\" (UID: \"de7bd1e1-eb10-48e8-9f29-db2235f4f27f\") " pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:16.697241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/557bfea7-56e5-499e-b18c-440c11f55d9f-serving-cert\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.697662 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a183de41-885c-4a77-9971-470bf0631bbd-config-volume\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.697662 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.697662 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmffp\" (UniqueName: \"kubernetes.io/projected/a9e4caa0-abb4-42c3-a210-dce9c17caa66-kube-api-access-jmffp\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.697662 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskvl\" (UniqueName: \"kubernetes.io/projected/fc70db4a-592a-4944-9898-17be786a2c21-kube-api-access-cskvl\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.697662 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9e4caa0-abb4-42c3-a210-dce9c17caa66-config\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.697662 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.697367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv4tg\" (UniqueName: \"kubernetes.io/projected/351f7978-35dc-470b-acfb-9fa4cf1fa18f-kube-api-access-kv4tg\") pod \"network-check-source-dbd9cf844-vrclj\" (UID: \"351f7978-35dc-470b-acfb-9fa4cf1fa18f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" Jun 03 19:41:16.720103 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.720065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:16.798626 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.798545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls5k9\" (UniqueName: \"kubernetes.io/projected/a183de41-885c-4a77-9971-470bf0631bbd-kube-api-access-ls5k9\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.798626 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.798582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de7bd1e1-eb10-48e8-9f29-db2235f4f27f-cert\") pod \"ingress-canary-4p8zp\" (UID: \"de7bd1e1-eb10-48e8-9f29-db2235f4f27f\") " pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:16.798626 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.798601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-bound-sa-token\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.798903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc70db4a-592a-4944-9898-17be786a2c21-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.798947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f463e3a-575a-4f0e-a204-d3a807cdc361-trusted-ca-bundle\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.798977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/557bfea7-56e5-499e-b18c-440c11f55d9f-trusted-ca\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw89r\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-kube-api-access-kw89r\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc70db4a-592a-4944-9898-17be786a2c21-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-stats-auth\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6c421-1794-4d3b-994b-615041274c88-ca-trust-extracted\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.799168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5lqf\" (UniqueName: \"kubernetes.io/projected/0f463e3a-575a-4f0e-a204-d3a807cdc361-kube-api-access-w5lqf\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76a35794-56f3-42ab-af30-446edb2934be-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9bn\" (UniqueName: \"kubernetes.io/projected/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-kube-api-access-5p9bn\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k742\" (UniqueName: \"kubernetes.io/projected/7f5d43ce-cfc0-472a-a217-7a6e484feb81-kube-api-access-4k742\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f463e3a-575a-4f0e-a204-d3a807cdc361-serving-cert\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.799337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9e4caa0-abb4-42c3-a210-dce9c17caa66-serving-cert\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.799404 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:41:16.799587 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.799478 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls podName:7f5d43ce-cfc0-472a-a217-7a6e484feb81 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.299460311 +0000 UTC m=+35.609617556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-tnllg" (UID: "7f5d43ce-cfc0-472a-a217-7a6e484feb81") : secret "samples-operator-tls" not found Jun 03 19:41:16.800385 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a183de41-885c-4a77-9971-470bf0631bbd-tmp-dir\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.800385 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:16.800385 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-image-registry-private-configuration\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.800385 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f463e3a-575a-4f0e-a204-d3a807cdc361-trusted-ca-bundle\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.800385 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f463e3a-575a-4f0e-a204-d3a807cdc361-snapshots\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f463e3a-575a-4f0e-a204-d3a807cdc361-service-ca-bundle\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-installation-pull-secrets\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/557bfea7-56e5-499e-b18c-440c11f55d9f-trusted-ca\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkxk\" (UniqueName: \"kubernetes.io/projected/76a35794-56f3-42ab-af30-446edb2934be-kube-api-access-nzkxk\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-registry-certificates\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6c421-1794-4d3b-994b-615041274c88-ca-trust-extracted\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.800604 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/557bfea7-56e5-499e-b18c-440c11f55d9f-config\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31999664-3290-426f-be81-720cc7036299-nginx-conf\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p279h\" (UniqueName: \"kubernetes.io/projected/de7bd1e1-eb10-48e8-9f29-db2235f4f27f-kube-api-access-p279h\") pod \"ingress-canary-4p8zp\" (UID: \"de7bd1e1-eb10-48e8-9f29-db2235f4f27f\") " pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/557bfea7-56e5-499e-b18c-440c11f55d9f-serving-cert\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a183de41-885c-4a77-9971-470bf0631bbd-config-volume\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmffp\" (UniqueName: \"kubernetes.io/projected/a9e4caa0-abb4-42c3-a210-dce9c17caa66-kube-api-access-jmffp\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cskvl\" (UniqueName: \"kubernetes.io/projected/fc70db4a-592a-4944-9898-17be786a2c21-kube-api-access-cskvl\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9e4caa0-abb4-42c3-a210-dce9c17caa66-config\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800854 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a183de41-885c-4a77-9971-470bf0631bbd-tmp-dir\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv4tg\" (UniqueName: \"kubernetes.io/projected/351f7978-35dc-470b-acfb-9fa4cf1fa18f-kube-api-access-kv4tg\") pod \"network-check-source-dbd9cf844-vrclj\" (UID: \"351f7978-35dc-470b-acfb-9fa4cf1fa18f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc52z\" (UniqueName: \"kubernetes.io/projected/557bfea7-56e5-499e-b18c-440c11f55d9f-kube-api-access-xc52z\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.800913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.800944 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.801010 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert podName:31999664-3290-426f-be81-720cc7036299 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.300993741 +0000 UTC m=+35.611150984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xglz6" (UID: "31999664-3290-426f-be81-720cc7036299") : secret "networking-console-plugin-cert" not found Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.801122 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76a35794-56f3-42ab-af30-446edb2934be-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.801338 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.801216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f463e3a-575a-4f0e-a204-d3a807cdc361-tmp\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.801260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-trusted-ca\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.801286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-default-certificate\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.801318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhw7l\" (UniqueName: \"kubernetes.io/projected/a69dfa68-e1af-466a-ad6c-610762bdcfc0-kube-api-access-bhw7l\") pod \"volume-data-source-validator-78dd696465-c5xfk\" (UID: \"a69dfa68-e1af-466a-ad6c-610762bdcfc0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.801617 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.801665 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.301649639 +0000 UTC m=+35.611806882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : secret "router-metrics-certs-default" not found Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.801748 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.801782 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls podName:76a35794-56f3-42ab-af30-446edb2934be nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.301770254 +0000 UTC m=+35.611927498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-8p6k4" (UID: "76a35794-56f3-42ab-af30-446edb2934be") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:16.802079 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.801924 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.301903147 +0000 UTC m=+35.612060395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : configmap references non-existent config key: service-ca.crt Jun 03 19:41:16.802468 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.802277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f463e3a-575a-4f0e-a204-d3a807cdc361-snapshots\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.802514 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.802462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-registry-certificates\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.803086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/557bfea7-56e5-499e-b18c-440c11f55d9f-config\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.803148 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc70db4a-592a-4944-9898-17be786a2c21-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.803652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f463e3a-575a-4f0e-a204-d3a807cdc361-service-ca-bundle\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.803837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31999664-3290-426f-be81-720cc7036299-nginx-conf\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.804102 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.804155 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls podName:a183de41-885c-4a77-9971-470bf0631bbd nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.304138675 +0000 UTC m=+35.614295918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls") pod "dns-default-zxpgd" (UID: "a183de41-885c-4a77-9971-470bf0631bbd") : secret "dns-default-metrics-tls" not found Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.804185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a183de41-885c-4a77-9971-470bf0631bbd-config-volume\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.804193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9e4caa0-abb4-42c3-a210-dce9c17caa66-config\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.804503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.804426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f463e3a-575a-4f0e-a204-d3a807cdc361-serving-cert\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.805070 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.804509 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f463e3a-575a-4f0e-a204-d3a807cdc361-tmp\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.805070 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.804522 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:41:16.805070 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.804536 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc994f9d6-srgr6: secret "image-registry-tls" not found Jun 03 19:41:16.805070 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:16.804621 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls podName:11a6c421-1794-4d3b-994b-615041274c88 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.304606093 +0000 UTC m=+35.614763337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls") pod "image-registry-5bc994f9d6-srgr6" (UID: "11a6c421-1794-4d3b-994b-615041274c88") : secret "image-registry-tls" not found Jun 03 19:41:16.805070 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.804623 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9e4caa0-abb4-42c3-a210-dce9c17caa66-serving-cert\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.805314 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.805092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-stats-auth\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.805314 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.805146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc70db4a-592a-4944-9898-17be786a2c21-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.805314 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.805187 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-trusted-ca\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.806398 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.806054 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de7bd1e1-eb10-48e8-9f29-db2235f4f27f-cert\") pod \"ingress-canary-4p8zp\" (UID: \"de7bd1e1-eb10-48e8-9f29-db2235f4f27f\") " pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:16.806548 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.806530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-installation-pull-secrets\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.807085 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.807060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-default-certificate\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.807837 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.807816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/557bfea7-56e5-499e-b18c-440c11f55d9f-serving-cert\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.807837 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.807829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-image-registry-private-configuration\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.811757 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.811614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw89r\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-kube-api-access-kw89r\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.811757 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.811666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5lqf\" (UniqueName: \"kubernetes.io/projected/0f463e3a-575a-4f0e-a204-d3a807cdc361-kube-api-access-w5lqf\") pod \"insights-operator-69684796bc-mm7qk\" (UID: \"0f463e3a-575a-4f0e-a204-d3a807cdc361\") " pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.811757 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.811705 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-bound-sa-token\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:16.811987 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.811851 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkxk\" (UniqueName: \"kubernetes.io/projected/76a35794-56f3-42ab-af30-446edb2934be-kube-api-access-nzkxk\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:16.812147 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.812129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9bn\" (UniqueName: \"kubernetes.io/projected/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-kube-api-access-5p9bn\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:16.812323 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.812299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k742\" (UniqueName: \"kubernetes.io/projected/7f5d43ce-cfc0-472a-a217-7a6e484feb81-kube-api-access-4k742\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:16.813157 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.813096 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhw7l\" (UniqueName: \"kubernetes.io/projected/a69dfa68-e1af-466a-ad6c-610762bdcfc0-kube-api-access-bhw7l\") pod \"volume-data-source-validator-78dd696465-c5xfk\" (UID: \"a69dfa68-e1af-466a-ad6c-610762bdcfc0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" Jun 03 19:41:16.813956 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.813929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls5k9\" (UniqueName: \"kubernetes.io/projected/a183de41-885c-4a77-9971-470bf0631bbd-kube-api-access-ls5k9\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:16.814950 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.814925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmffp\" (UniqueName: \"kubernetes.io/projected/a9e4caa0-abb4-42c3-a210-dce9c17caa66-kube-api-access-jmffp\") pod \"service-ca-operator-5bc4cf794b-nt95z\" (UID: \"a9e4caa0-abb4-42c3-a210-dce9c17caa66\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.815038 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.814980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p279h\" (UniqueName: \"kubernetes.io/projected/de7bd1e1-eb10-48e8-9f29-db2235f4f27f-kube-api-access-p279h\") pod \"ingress-canary-4p8zp\" (UID: \"de7bd1e1-eb10-48e8-9f29-db2235f4f27f\") " pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:16.815410 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.815389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv4tg\" (UniqueName: \"kubernetes.io/projected/351f7978-35dc-470b-acfb-9fa4cf1fa18f-kube-api-access-kv4tg\") pod \"network-check-source-dbd9cf844-vrclj\" (UID: \"351f7978-35dc-470b-acfb-9fa4cf1fa18f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" Jun 03 19:41:16.815888 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.815873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc52z\" (UniqueName: \"kubernetes.io/projected/557bfea7-56e5-499e-b18c-440c11f55d9f-kube-api-access-xc52z\") pod \"console-operator-85bd8fd97d-p7qjt\" (UID: \"557bfea7-56e5-499e-b18c-440c11f55d9f\") " pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.816920 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.816900 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskvl\" (UniqueName: \"kubernetes.io/projected/fc70db4a-592a-4944-9898-17be786a2c21-kube-api-access-cskvl\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9\" (UID: \"fc70db4a-592a-4944-9898-17be786a2c21\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.831395 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.831352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:16.862511 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.862485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" Jun 03 19:41:16.870340 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.870316 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:16.912639 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.912503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" Jun 03 19:41:16.922031 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.921833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" Jun 03 19:41:16.929220 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.929028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-mm7qk" Jun 03 19:41:16.939266 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.938895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" Jun 03 19:41:16.967846 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:16.966622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4p8zp" Jun 03 19:41:17.092911 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.092697 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:17.095711 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.093291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:17.095711 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.093752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:17.096791 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.095930 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:41:17.096791 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.096262 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sqzbn\"" Jun 03 19:41:17.096791 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.096446 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4l42f\"" Jun 03 19:41:17.096791 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.096643 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:41:17.110836 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.110757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk"] Jun 03 19:41:17.119665 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:17.118884 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69dfa68_e1af_466a_ad6c_610762bdcfc0.slice/crio-72e741c3c7a962529bd7e053a575c9fae1ff940d02205aea21328dbe15e1adef WatchSource:0}: Error finding container 72e741c3c7a962529bd7e053a575c9fae1ff940d02205aea21328dbe15e1adef: Status 404 returned error can't find the container with id 72e741c3c7a962529bd7e053a575c9fae1ff940d02205aea21328dbe15e1adef Jun 03 19:41:17.131814 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.130920 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-p7qjt"] Jun 03 19:41:17.143883 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.143407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z"] Jun 03 19:41:17.151623 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.151115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9"] Jun 03 19:41:17.198349 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.198271 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-mm7qk"] Jun 03 19:41:17.200169 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.200114 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4p8zp"] Jun 03 19:41:17.201650 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:17.201622 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f463e3a_575a_4f0e_a204_d3a807cdc361.slice/crio-4e8a95c642b5c6b921bc9fefd90ec2e7f534587edf955417460576e6eb7ea7d2 WatchSource:0}: Error finding container 4e8a95c642b5c6b921bc9fefd90ec2e7f534587edf955417460576e6eb7ea7d2: Status 404 returned error can't find the container with id 4e8a95c642b5c6b921bc9fefd90ec2e7f534587edf955417460576e6eb7ea7d2 Jun 03 19:41:17.202942 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:17.202890 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7bd1e1_eb10_48e8_9f29_db2235f4f27f.slice/crio-97c8254457f9bb052b19cdf3171f9c60702ea873f66266ada51687aac37618c2 WatchSource:0}: Error finding container 97c8254457f9bb052b19cdf3171f9c60702ea873f66266ada51687aac37618c2: Status 404 returned error can't find the container with id 97c8254457f9bb052b19cdf3171f9c60702ea873f66266ada51687aac37618c2 Jun 03 19:41:17.222078 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.222046 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj"] Jun 03 19:41:17.225498 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:17.225474 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351f7978_35dc_470b_acfb_9fa4cf1fa18f.slice/crio-b98f00a1064cfc4b47e4c696f7715053f6542124fb7feb187012d37ea2f16a39 WatchSource:0}: Error finding container b98f00a1064cfc4b47e4c696f7715053f6542124fb7feb187012d37ea2f16a39: Status 404 returned error can't find the container with id b98f00a1064cfc4b47e4c696f7715053f6542124fb7feb187012d37ea2f16a39 Jun 03 19:41:17.306776 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.306740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:17.306939 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.306787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:17.306939 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.306840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:17.306939 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.306895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:17.306939 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.306912 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:41:17.306939 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.306930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.306964 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.306973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.306988 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert podName:31999664-3290-426f-be81-720cc7036299 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:18.306967219 +0000 UTC m=+36.617124468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xglz6" (UID: "31999664-3290-426f-be81-720cc7036299") : secret "networking-console-plugin-cert" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307020 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:18.307010509 +0000 UTC m=+36.617167738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : secret "router-metrics-certs-default" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.306912 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307046 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls podName:76a35794-56f3-42ab-af30-446edb2934be nodeName:}" failed. No retries permitted until 2026-06-03 19:41:18.307041097 +0000 UTC m=+36.617198325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-8p6k4" (UID: "76a35794-56f3-42ab-af30-446edb2934be") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307048 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307073 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307083 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls podName:a183de41-885c-4a77-9971-470bf0631bbd nodeName:}" failed. No retries permitted until 2026-06-03 19:41:18.307064342 +0000 UTC m=+36.617221571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls") pod "dns-default-zxpgd" (UID: "a183de41-885c-4a77-9971-470bf0631bbd") : secret "dns-default-metrics-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307086 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc994f9d6-srgr6: secret "image-registry-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307116 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307126 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls podName:11a6c421-1794-4d3b-994b-615041274c88 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:18.307113442 +0000 UTC m=+36.617270692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls") pod "image-registry-5bc994f9d6-srgr6" (UID: "11a6c421-1794-4d3b-994b-615041274c88") : secret "image-registry-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307138 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls podName:7f5d43ce-cfc0-472a-a217-7a6e484feb81 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:18.307131342 +0000 UTC m=+36.617288570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-tnllg" (UID: "7f5d43ce-cfc0-472a-a217-7a6e484feb81") : secret "samples-operator-tls" not found Jun 03 19:41:17.307186 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.307179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:17.307730 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:17.307305 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:18.30729316 +0000 UTC m=+36.617450411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : configmap references non-existent config key: service-ca.crt Jun 03 19:41:17.345370 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.345334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" event={"ID":"351f7978-35dc-470b-acfb-9fa4cf1fa18f","Type":"ContainerStarted","Data":"b98f00a1064cfc4b47e4c696f7715053f6542124fb7feb187012d37ea2f16a39"} Jun 03 19:41:17.346633 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.346608 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" event={"ID":"fc70db4a-592a-4944-9898-17be786a2c21","Type":"ContainerStarted","Data":"8a530a24ea534104e9d569487c845ad37fa64f6f7ea7ee435346617d2f7da960"} Jun 03 19:41:17.347892 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.347871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" event={"ID":"557bfea7-56e5-499e-b18c-440c11f55d9f","Type":"ContainerStarted","Data":"4f08f905477edb80d5b22f699272a871acfee0aa69782c7659200b019f34569c"} Jun 03 19:41:17.349058 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.349033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4p8zp" event={"ID":"de7bd1e1-eb10-48e8-9f29-db2235f4f27f","Type":"ContainerStarted","Data":"97c8254457f9bb052b19cdf3171f9c60702ea873f66266ada51687aac37618c2"} Jun 03 19:41:17.350293 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.350269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mm7qk" event={"ID":"0f463e3a-575a-4f0e-a204-d3a807cdc361","Type":"ContainerStarted","Data":"4e8a95c642b5c6b921bc9fefd90ec2e7f534587edf955417460576e6eb7ea7d2"} Jun 03 19:41:17.351507 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.351477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" event={"ID":"a9e4caa0-abb4-42c3-a210-dce9c17caa66","Type":"ContainerStarted","Data":"1dc1a684afcadf9b9aecb2fd20bb8227db1d1e15c3734a0cf31c26d7ab032551"} Jun 03 19:41:17.352609 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:17.352585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" event={"ID":"a69dfa68-e1af-466a-ad6c-610762bdcfc0","Type":"ContainerStarted","Data":"72e741c3c7a962529bd7e053a575c9fae1ff940d02205aea21328dbe15e1adef"} Jun 03 19:41:18.317733 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:18.317694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:18.317757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:18.317810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:18.317862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:18.317933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:18.317963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:18.317992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.318255 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:41:18.318366 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.318323 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:20.318303761 +0000 UTC m=+38.628460997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : secret "router-metrics-certs-default" not found Jun 03 19:41:18.318811 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.318774 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:41:18.318862 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.318826 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls podName:a183de41-885c-4a77-9971-470bf0631bbd nodeName:}" failed. No retries permitted until 2026-06-03 19:41:20.318810958 +0000 UTC m=+38.628968190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls") pod "dns-default-zxpgd" (UID: "a183de41-885c-4a77-9971-470bf0631bbd") : secret "dns-default-metrics-tls" not found Jun 03 19:41:18.318981 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.318966 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:41:18.319037 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.318984 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc994f9d6-srgr6: secret "image-registry-tls" not found Jun 03 19:41:18.319037 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319021 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls podName:11a6c421-1794-4d3b-994b-615041274c88 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:20.319008396 +0000 UTC m=+38.629165629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls") pod "image-registry-5bc994f9d6-srgr6" (UID: "11a6c421-1794-4d3b-994b-615041274c88") : secret "image-registry-tls" not found Jun 03 19:41:18.319147 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319109 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:41:18.319147 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319145 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls podName:7f5d43ce-cfc0-472a-a217-7a6e484feb81 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:20.319133204 +0000 UTC m=+38.629290439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-tnllg" (UID: "7f5d43ce-cfc0-472a-a217-7a6e484feb81") : secret "samples-operator-tls" not found Jun 03 19:41:18.319251 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319213 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:20.319203296 +0000 UTC m=+38.629360531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : configmap references non-existent config key: service-ca.crt Jun 03 19:41:18.319304 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319269 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:41:18.319304 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319295 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert podName:31999664-3290-426f-be81-720cc7036299 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:20.319287431 +0000 UTC m=+38.629444659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xglz6" (UID: "31999664-3290-426f-be81-720cc7036299") : secret "networking-console-plugin-cert" not found Jun 03 19:41:18.319404 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319349 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:18.319404 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:18.319382 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls podName:76a35794-56f3-42ab-af30-446edb2934be nodeName:}" failed. No retries permitted until 2026-06-03 19:41:20.31937132 +0000 UTC m=+38.629528549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-8p6k4" (UID: "76a35794-56f3-42ab-af30-446edb2934be") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:20.337050 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:20.337017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:20.337050 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:20.337056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:20.337084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337203 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337230 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:20.337238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337262 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:24.337243995 +0000 UTC m=+42.647401226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : secret "router-metrics-certs-default" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337202 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337292 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls podName:76a35794-56f3-42ab-af30-446edb2934be nodeName:}" failed. No retries permitted until 2026-06-03 19:41:24.337281719 +0000 UTC m=+42.647438953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-8p6k4" (UID: "76a35794-56f3-42ab-af30-446edb2934be") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337311 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:20.337330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337356 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls podName:a183de41-885c-4a77-9971-470bf0631bbd nodeName:}" failed. No retries permitted until 2026-06-03 19:41:24.337340878 +0000 UTC m=+42.647498107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls") pod "dns-default-zxpgd" (UID: "a183de41-885c-4a77-9971-470bf0631bbd") : secret "dns-default-metrics-tls" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337383 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert podName:31999664-3290-426f-be81-720cc7036299 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:24.337374605 +0000 UTC m=+42.647531837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xglz6" (UID: "31999664-3290-426f-be81-720cc7036299") : secret "networking-console-plugin-cert" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337406 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337420 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc994f9d6-srgr6: secret "image-registry-tls" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:20.337432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337457 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls podName:11a6c421-1794-4d3b-994b-615041274c88 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:24.33744338 +0000 UTC m=+42.647600612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls") pod "image-registry-5bc994f9d6-srgr6" (UID: "11a6c421-1794-4d3b-994b-615041274c88") : secret "image-registry-tls" not found Jun 03 19:41:20.337518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337493 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:41:20.338171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:20.337521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:20.338171 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337532 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls podName:7f5d43ce-cfc0-472a-a217-7a6e484feb81 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:24.337521504 +0000 UTC m=+42.647678734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-tnllg" (UID: "7f5d43ce-cfc0-472a-a217-7a6e484feb81") : secret "samples-operator-tls" not found Jun 03 19:41:20.338171 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:20.337606 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:24.337594015 +0000 UTC m=+42.647751261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : configmap references non-existent config key: service-ca.crt Jun 03 19:41:21.396977 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:21.396940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:21.464638 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:21.464601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:22.180453 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:22.180408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:22.281373 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:22.281337 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:22.381543 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:22.381506 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:24.377112 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:24.377083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:24.377117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:24.377137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:24.377166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:24.377186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:24.377219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377254 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377275 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:24.377299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377315 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377285 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377334 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc994f9d6-srgr6: secret "image-registry-tls" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377317 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls podName:76a35794-56f3-42ab-af30-446edb2934be nodeName:}" failed. No retries permitted until 2026-06-03 19:41:32.37730289 +0000 UTC m=+50.687460123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-8p6k4" (UID: "76a35794-56f3-42ab-af30-446edb2934be") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377362 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:32.377351428 +0000 UTC m=+50.687508658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : secret "router-metrics-certs-default" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377254 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377375 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:32.377368808 +0000 UTC m=+50.687526036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : configmap references non-existent config key: service-ca.crt Jun 03 19:41:24.377523 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377386 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls podName:a183de41-885c-4a77-9971-470bf0631bbd nodeName:}" failed. No retries permitted until 2026-06-03 19:41:32.377380664 +0000 UTC m=+50.687537893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls") pod "dns-default-zxpgd" (UID: "a183de41-885c-4a77-9971-470bf0631bbd") : secret "dns-default-metrics-tls" not found Jun 03 19:41:24.378028 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377402 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls podName:11a6c421-1794-4d3b-994b-615041274c88 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:32.377395129 +0000 UTC m=+50.687552359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls") pod "image-registry-5bc994f9d6-srgr6" (UID: "11a6c421-1794-4d3b-994b-615041274c88") : secret "image-registry-tls" not found Jun 03 19:41:24.378028 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377404 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:41:24.378028 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377414 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert podName:31999664-3290-426f-be81-720cc7036299 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:32.37740906 +0000 UTC m=+50.687566289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xglz6" (UID: "31999664-3290-426f-be81-720cc7036299") : secret "networking-console-plugin-cert" not found Jun 03 19:41:24.378028 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:24.377426 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls podName:7f5d43ce-cfc0-472a-a217-7a6e484feb81 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:32.377421749 +0000 UTC m=+50.687578978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-tnllg" (UID: "7f5d43ce-cfc0-472a-a217-7a6e484feb81") : secret "samples-operator-tls" not found Jun 03 19:41:27.382759 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.382712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mm7qk" event={"ID":"0f463e3a-575a-4f0e-a204-d3a807cdc361","Type":"ContainerStarted","Data":"055b9f4d8e36ff865b97039e2420f3dbf3f3be97fd76721fca6ca7616c58de1f"} Jun 03 19:41:27.384725 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.384693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" event={"ID":"a9e4caa0-abb4-42c3-a210-dce9c17caa66","Type":"ContainerStarted","Data":"77a1c1684e4d176a25354c067255cf857dd04fc153927c97d1f67528d5d34784"} Jun 03 19:41:27.386168 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.386112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" event={"ID":"a69dfa68-e1af-466a-ad6c-610762bdcfc0","Type":"ContainerStarted","Data":"782e128119060efd5f2159b67c1cc7ce6d0d4b4bec2e370ad52080c0b2d82fed"} Jun 03 19:41:27.387606 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.387583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" event={"ID":"351f7978-35dc-470b-acfb-9fa4cf1fa18f","Type":"ContainerStarted","Data":"5add50fb8bc574e3e08133d6494751b49577dff5205f6e9cc7b634950c94ad0e"} Jun 03 19:41:27.389357 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.389333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" event={"ID":"fc70db4a-592a-4944-9898-17be786a2c21","Type":"ContainerStarted","Data":"269d28d0e1553bf4517b193b5240659eb00695ae7d601f6cbe64db24ce1a4865"} Jun 03 19:41:27.390888 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.390871 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/0.log" Jun 03 19:41:27.391014 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.390907 2562 generic.go:356] "Generic (PLEG): container finished" podID="557bfea7-56e5-499e-b18c-440c11f55d9f" containerID="3e0279106c1ecda73ce0521e8363be1be0dad23447c910a3b3a1457550c89aa2" exitCode=255 Jun 03 19:41:27.391014 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.390987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" event={"ID":"557bfea7-56e5-499e-b18c-440c11f55d9f","Type":"ContainerDied","Data":"3e0279106c1ecda73ce0521e8363be1be0dad23447c910a3b3a1457550c89aa2"} Jun 03 19:41:27.391220 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.391204 2562 scope.go:117] "RemoveContainer" containerID="3e0279106c1ecda73ce0521e8363be1be0dad23447c910a3b3a1457550c89aa2" Jun 03 19:41:27.394366 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.394341 2562 generic.go:356] "Generic (PLEG): container finished" podID="38eee980-1217-4628-a494-f1fbf53394cf" containerID="b3acb6ff5c7ae8bd3e747e6bf268cf91634399caf3785b384a24f18e76f15784" exitCode=0 Jun 03 19:41:27.394461 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.394386 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerDied","Data":"b3acb6ff5c7ae8bd3e747e6bf268cf91634399caf3785b384a24f18e76f15784"} Jun 03 19:41:27.396579 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.396561 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4p8zp" event={"ID":"de7bd1e1-eb10-48e8-9f29-db2235f4f27f","Type":"ContainerStarted","Data":"c0c647a113ae501ff135e990c6b3a6c99bef5ac6a8845e6cd9eb108d5c2532a9"} Jun 03 19:41:27.406837 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.406788 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-mm7qk" podStartSLOduration=34.278430277 podStartE2EDuration="43.406769685s" totalImagesPullingTime="9.128339408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:27.405911067 +0000 UTC m=+45.716068317" watchObservedRunningTime="2026-06-03 19:41:27.406769685 +0000 UTC m=+45.716926929" Jun 03 19:41:27.451993 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.451727 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-vrclj" podStartSLOduration=34.346912407 podStartE2EDuration="43.451699126s" totalImagesPullingTime="9.104786719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:27.450571734 +0000 UTC m=+45.760728983" watchObservedRunningTime="2026-06-03 19:41:27.451699126 +0000 UTC m=+45.761856369" Jun 03 19:41:27.488943 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.488600 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-c5xfk" podStartSLOduration=34.277899843 podStartE2EDuration="43.488576413s" totalImagesPullingTime="9.21067657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:27.48743722 +0000 UTC m=+45.797594472" watchObservedRunningTime="2026-06-03 19:41:27.488576413 +0000 UTC m=+45.798733668" Jun 03 19:41:27.488943 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.488890 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4p8zp" podStartSLOduration=2.362310233 podStartE2EDuration="11.488879587s" totalImagesPullingTime="9.126569354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:27.470241436 +0000 UTC m=+45.780398683" watchObservedRunningTime="2026-06-03 19:41:27.488879587 +0000 UTC m=+45.799036843" Jun 03 19:41:27.533549 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.533500 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" podStartSLOduration=34.359289324 podStartE2EDuration="43.533485931s" totalImagesPullingTime="9.174196607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:27.533276075 +0000 UTC m=+45.843433326" watchObservedRunningTime="2026-06-03 19:41:27.533485931 +0000 UTC m=+45.843643182" Jun 03 19:41:27.550171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:27.550118 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" podStartSLOduration=34.371681815 podStartE2EDuration="43.550097144s" totalImagesPullingTime="9.178415329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:27.548977244 +0000 UTC m=+45.859134494" watchObservedRunningTime="2026-06-03 19:41:27.550097144 +0000 UTC m=+45.860254396" Jun 03 19:41:28.402858 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.402827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:41:28.403257 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.403241 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/0.log" Jun 03 19:41:28.403298 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.403278 2562 generic.go:356] "Generic (PLEG): container finished" podID="557bfea7-56e5-499e-b18c-440c11f55d9f" containerID="614ba80719cc457aa094c285879883d67bda69bf7fb44b814ef44cc4d9166413" exitCode=255 Jun 03 19:41:28.403374 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.403355 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" event={"ID":"557bfea7-56e5-499e-b18c-440c11f55d9f","Type":"ContainerDied","Data":"614ba80719cc457aa094c285879883d67bda69bf7fb44b814ef44cc4d9166413"} Jun 03 19:41:28.403427 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.403407 2562 scope.go:117] "RemoveContainer" containerID="3e0279106c1ecda73ce0521e8363be1be0dad23447c910a3b3a1457550c89aa2" Jun 03 19:41:28.403644 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.403628 2562 scope.go:117] "RemoveContainer" containerID="614ba80719cc457aa094c285879883d67bda69bf7fb44b814ef44cc4d9166413" Jun 03 19:41:28.403845 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:28.403826 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-p7qjt_openshift-console-operator(557bfea7-56e5-499e-b18c-440c11f55d9f)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" podUID="557bfea7-56e5-499e-b18c-440c11f55d9f" Jun 03 19:41:28.406783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.406763 2562 generic.go:356] "Generic (PLEG): container finished" podID="38eee980-1217-4628-a494-f1fbf53394cf" containerID="589a5838aab5a90f9e3a1a159ef0bf7c434c1bcb7878029571eb2bd8140d772c" exitCode=0 Jun 03 19:41:28.406932 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.406857 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerDied","Data":"589a5838aab5a90f9e3a1a159ef0bf7c434c1bcb7878029571eb2bd8140d772c"} Jun 03 19:41:28.468563 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.468530 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg"] Jun 03 19:41:28.494698 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.494660 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg"] Jun 03 19:41:28.494819 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.494771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" Jun 03 19:41:28.497098 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.497078 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 19:41:28.497229 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.497113 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 19:41:28.497229 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.497121 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tsf5v\"" Jun 03 19:41:28.519670 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.519563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lng6\" (UniqueName: \"kubernetes.io/projected/a229502e-43c5-4e83-a85a-641526fc518d-kube-api-access-9lng6\") pod \"migrator-955ffdf5f-st2dg\" (UID: \"a229502e-43c5-4e83-a85a-641526fc518d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" Jun 03 19:41:28.621163 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.621125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lng6\" (UniqueName: \"kubernetes.io/projected/a229502e-43c5-4e83-a85a-641526fc518d-kube-api-access-9lng6\") pod \"migrator-955ffdf5f-st2dg\" (UID: \"a229502e-43c5-4e83-a85a-641526fc518d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" Jun 03 19:41:28.631524 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.631494 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lng6\" (UniqueName: \"kubernetes.io/projected/a229502e-43c5-4e83-a85a-641526fc518d-kube-api-access-9lng6\") pod \"migrator-955ffdf5f-st2dg\" (UID: \"a229502e-43c5-4e83-a85a-641526fc518d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" Jun 03 19:41:28.813708 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.813602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" Jun 03 19:41:28.967014 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:28.966935 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg"] Jun 03 19:41:28.969814 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:28.969783 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda229502e_43c5_4e83_a85a_641526fc518d.slice/crio-658f26fe244d61e96f6ea5430823a654cfdf1c77479ef80779a9aabee5f97b12 WatchSource:0}: Error finding container 658f26fe244d61e96f6ea5430823a654cfdf1c77479ef80779a9aabee5f97b12: Status 404 returned error can't find the container with id 658f26fe244d61e96f6ea5430823a654cfdf1c77479ef80779a9aabee5f97b12 Jun 03 19:41:29.413899 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.413832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:41:29.414279 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.414235 2562 scope.go:117] "RemoveContainer" containerID="614ba80719cc457aa094c285879883d67bda69bf7fb44b814ef44cc4d9166413" Jun 03 19:41:29.414429 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:29.414407 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-p7qjt_openshift-console-operator(557bfea7-56e5-499e-b18c-440c11f55d9f)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" podUID="557bfea7-56e5-499e-b18c-440c11f55d9f" Jun 03 19:41:29.415021 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.414997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" event={"ID":"a229502e-43c5-4e83-a85a-641526fc518d","Type":"ContainerStarted","Data":"658f26fe244d61e96f6ea5430823a654cfdf1c77479ef80779a9aabee5f97b12"} Jun 03 19:41:29.418107 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.418085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" event={"ID":"38eee980-1217-4628-a494-f1fbf53394cf","Type":"ContainerStarted","Data":"ee444cdfd9474695995b3a77756e926474991d2861a8c08523c24a3e78d42cfa"} Jun 03 19:41:29.453794 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.453740 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5q4fw" podStartSLOduration=10.138738968 podStartE2EDuration="47.453725148s" totalImagesPullingTime="37.31498618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:29.452760483 +0000 UTC m=+47.762917735" watchObservedRunningTime="2026-06-03 19:41:29.453725148 +0000 UTC m=+47.763882424" Jun 03 19:41:29.648322 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.648289 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-jg6p8"] Jun 03 19:41:29.659229 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.659201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.659876 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.659597 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-jg6p8"] Jun 03 19:41:29.662091 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.662065 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 19:41:29.662200 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.662150 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 19:41:29.662555 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.662533 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 19:41:29.662719 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.662665 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k42lr\"" Jun 03 19:41:29.663029 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.662880 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 19:41:29.722600 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.722574 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zxqck_33e570aa-ee54-4f06-acc7-27580e36aea6/dns-node-resolver/0.log" Jun 03 19:41:29.732097 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.732072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p28n\" (UniqueName: \"kubernetes.io/projected/aa9542e0-f548-40cb-b03d-93f27a03288c-kube-api-access-9p28n\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.732241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.732186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa9542e0-f548-40cb-b03d-93f27a03288c-signing-key\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.732304 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.732265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa9542e0-f548-40cb-b03d-93f27a03288c-signing-cabundle\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.832919 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.832885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p28n\" (UniqueName: \"kubernetes.io/projected/aa9542e0-f548-40cb-b03d-93f27a03288c-kube-api-access-9p28n\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.833083 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.832966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa9542e0-f548-40cb-b03d-93f27a03288c-signing-key\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.833083 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.833014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa9542e0-f548-40cb-b03d-93f27a03288c-signing-cabundle\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.833754 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.833736 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa9542e0-f548-40cb-b03d-93f27a03288c-signing-cabundle\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.835403 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.835385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa9542e0-f548-40cb-b03d-93f27a03288c-signing-key\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.842409 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.842387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p28n\" (UniqueName: \"kubernetes.io/projected/aa9542e0-f548-40cb-b03d-93f27a03288c-kube-api-access-9p28n\") pod \"service-ca-7d74d578b8-jg6p8\" (UID: \"aa9542e0-f548-40cb-b03d-93f27a03288c\") " pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:29.972060 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:29.971981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" Jun 03 19:41:30.142141 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:30.142112 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-jg6p8"] Jun 03 19:41:30.323358 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:30.323286 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9542e0_f548_40cb_b03d_93f27a03288c.slice/crio-fe65c52af289e6f82f806c68aa66fc3437049075506437db1f61ea93e8ca4c2b WatchSource:0}: Error finding container fe65c52af289e6f82f806c68aa66fc3437049075506437db1f61ea93e8ca4c2b: Status 404 returned error can't find the container with id fe65c52af289e6f82f806c68aa66fc3437049075506437db1f61ea93e8ca4c2b Jun 03 19:41:30.422722 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:30.422653 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" event={"ID":"aa9542e0-f548-40cb-b03d-93f27a03288c","Type":"ContainerStarted","Data":"ba2e272e8ac3a8f5650420a9d3711d2861af1aa05003ad2f49bdd3ce60405414"} Jun 03 19:41:30.422722 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:30.422722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" event={"ID":"aa9542e0-f548-40cb-b03d-93f27a03288c","Type":"ContainerStarted","Data":"fe65c52af289e6f82f806c68aa66fc3437049075506437db1f61ea93e8ca4c2b"} Jun 03 19:41:30.724314 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:30.724292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-665bw_77a7d526-661c-4266-8e77-d74d1961fb46/node-ca/0.log" Jun 03 19:41:31.125430 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:31.125389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4p8zp_de7bd1e1-eb10-48e8-9f29-db2235f4f27f/serve-healthcheck-canary/0.log" Jun 03 19:41:31.429741 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:31.429626 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" event={"ID":"a229502e-43c5-4e83-a85a-641526fc518d","Type":"ContainerStarted","Data":"b8e91d231b796be6ba0795c4c1fffbe16af7c615835bdabba78d1df9a3f59010"} Jun 03 19:41:31.430130 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:31.429754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" event={"ID":"a229502e-43c5-4e83-a85a-641526fc518d","Type":"ContainerStarted","Data":"77b2a3dbe9abd64d50ea828cd6eeaa9aa20f2f12d0fa6887ef686b45e36e2c1a"} Jun 03 19:41:31.452402 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:31.452331 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-st2dg" podStartSLOduration=1.754543254 podStartE2EDuration="3.452310948s" totalImagesPullingTime="1.697767694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:31.448166183 +0000 UTC m=+49.758323434" watchObservedRunningTime="2026-06-03 19:41:31.452310948 +0000 UTC m=+49.762468200" Jun 03 19:41:31.468231 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:31.468194 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-jg6p8" podStartSLOduration=2.4681814810000002 podStartE2EDuration="2.468181481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:31.467504664 +0000 UTC m=+49.777661916" watchObservedRunningTime="2026-06-03 19:41:31.468181481 +0000 UTC m=+49.778338732" Jun 03 19:41:32.458171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:32.458135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:32.458188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:32.458233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:32.458281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458292 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:32.458343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458364 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls podName:a183de41-885c-4a77-9971-470bf0631bbd nodeName:}" failed. No retries permitted until 2026-06-03 19:41:48.458342936 +0000 UTC m=+66.768500182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls") pod "dns-default-zxpgd" (UID: "a183de41-885c-4a77-9971-470bf0631bbd") : secret "dns-default-metrics-tls" not found Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458425 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458477 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert podName:31999664-3290-426f-be81-720cc7036299 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:48.458461895 +0000 UTC m=+66.768619128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xglz6" (UID: "31999664-3290-426f-be81-720cc7036299") : secret "networking-console-plugin-cert" not found Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458508 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:48.458485329 +0000 UTC m=+66.768642558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : configmap references non-existent config key: service-ca.crt Jun 03 19:41:32.458625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:32.458564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458699 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458762 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls podName:76a35794-56f3-42ab-af30-446edb2934be nodeName:}" failed. No retries permitted until 2026-06-03 19:41:48.458747737 +0000 UTC m=+66.768904982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-8p6k4" (UID: "76a35794-56f3-42ab-af30-446edb2934be") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:32.458790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458831 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458868 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458881 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458896 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls podName:7f5d43ce-cfc0-472a-a217-7a6e484feb81 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:48.458864722 +0000 UTC m=+66.769021966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-tnllg" (UID: "7f5d43ce-cfc0-472a-a217-7a6e484feb81") : secret "samples-operator-tls" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458899 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc994f9d6-srgr6: secret "image-registry-tls" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458935 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs podName:ed04c8db-bd0b-4bb0-858f-34e087e2d38d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:48.458923276 +0000 UTC m=+66.769080508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs") pod "router-default-6dfc6575cf-lqd8h" (UID: "ed04c8db-bd0b-4bb0-858f-34e087e2d38d") : secret "router-metrics-certs-default" not found Jun 03 19:41:32.459172 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:32.458951 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls podName:11a6c421-1794-4d3b-994b-615041274c88 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:48.45894215 +0000 UTC m=+66.769099380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls") pod "image-registry-5bc994f9d6-srgr6" (UID: "11a6c421-1794-4d3b-994b-615041274c88") : secret "image-registry-tls" not found Jun 03 19:41:36.870852 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:36.870817 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:36.871518 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:36.870874 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:36.871518 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:36.871290 2562 scope.go:117] "RemoveContainer" containerID="614ba80719cc457aa094c285879883d67bda69bf7fb44b814ef44cc4d9166413" Jun 03 19:41:36.871518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:41:36.871459 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-p7qjt_openshift-console-operator(557bfea7-56e5-499e-b18c-440c11f55d9f)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" podUID="557bfea7-56e5-499e-b18c-440c11f55d9f" Jun 03 19:41:43.342451 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:43.342418 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwp6r" Jun 03 19:41:47.797063 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:47.797025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:47.799484 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:47.799465 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:41:47.810035 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:47.810012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36186242-9a2e-4793-90ec-518e85baecb3-metrics-certs\") pod \"network-metrics-daemon-82bwq\" (UID: \"36186242-9a2e-4793-90ec-518e85baecb3\") " pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:47.898497 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:47.898463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:47.900983 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:47.900964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:41:47.910940 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:47.910915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceb4dea7-8538-462d-92c9-3087b9d43c0c-original-pull-secret\") pod \"global-pull-secret-syncer-j5wkc\" (UID: \"ceb4dea7-8538-462d-92c9-3087b9d43c0c\") " pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:47.999546 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:47.999512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:48.002032 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.002012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv2bk\" (UniqueName: \"kubernetes.io/projected/d7d99910-d615-43e7-8201-19bf4b81354e-kube-api-access-tv2bk\") pod \"network-check-target-885bc\" (UID: \"d7d99910-d615-43e7-8201-19bf4b81354e\") " pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:48.027970 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.027923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5wkc" Jun 03 19:41:48.053473 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.053409 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sqzbn\"" Jun 03 19:41:48.061283 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.061263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82bwq" Jun 03 19:41:48.064951 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.064927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4l42f\"" Jun 03 19:41:48.072831 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.072803 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:48.172820 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.172785 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5wkc"] Jun 03 19:41:48.175723 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:48.175637 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb4dea7_8538_462d_92c9_3087b9d43c0c.slice/crio-08c0a9e975487171e5dba3f7a353820e8866be4d9bdccb0b50ec31debc5e451d WatchSource:0}: Error finding container 08c0a9e975487171e5dba3f7a353820e8866be4d9bdccb0b50ec31debc5e451d: Status 404 returned error can't find the container with id 08c0a9e975487171e5dba3f7a353820e8866be4d9bdccb0b50ec31debc5e451d Jun 03 19:41:48.203191 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.203162 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82bwq"] Jun 03 19:41:48.206495 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:48.206468 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36186242_9a2e_4793_90ec_518e85baecb3.slice/crio-e571a804556f1fb1eb7b7080af487bfb4eda5af1cec2a96b83ac5fe743c9750d WatchSource:0}: Error finding container e571a804556f1fb1eb7b7080af487bfb4eda5af1cec2a96b83ac5fe743c9750d: Status 404 returned error can't find the container with id e571a804556f1fb1eb7b7080af487bfb4eda5af1cec2a96b83ac5fe743c9750d Jun 03 19:41:48.220196 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.220175 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-885bc"] Jun 03 19:41:48.222479 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:48.222455 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d99910_d615_43e7_8201_19bf4b81354e.slice/crio-abca015219cd25c01139ed824413aa866b9a350250bf9e1e5d1f509cec999027 WatchSource:0}: Error finding container abca015219cd25c01139ed824413aa866b9a350250bf9e1e5d1f509cec999027: Status 404 returned error can't find the container with id abca015219cd25c01139ed824413aa866b9a350250bf9e1e5d1f509cec999027 Jun 03 19:41:48.486625 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.486593 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82bwq" event={"ID":"36186242-9a2e-4793-90ec-518e85baecb3","Type":"ContainerStarted","Data":"e571a804556f1fb1eb7b7080af487bfb4eda5af1cec2a96b83ac5fe743c9750d"} Jun 03 19:41:48.488066 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.488041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-885bc" event={"ID":"d7d99910-d615-43e7-8201-19bf4b81354e","Type":"ContainerStarted","Data":"f79b2a1d754fa64551ce205ea5b3f87b30918d8477dc2bc696aaa3b2844a0eb6"} Jun 03 19:41:48.488206 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.488082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-885bc" event={"ID":"d7d99910-d615-43e7-8201-19bf4b81354e","Type":"ContainerStarted","Data":"abca015219cd25c01139ed824413aa866b9a350250bf9e1e5d1f509cec999027"} Jun 03 19:41:48.488206 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.488111 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:41:48.489085 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.489063 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5wkc" event={"ID":"ceb4dea7-8538-462d-92c9-3087b9d43c0c","Type":"ContainerStarted","Data":"08c0a9e975487171e5dba3f7a353820e8866be4d9bdccb0b50ec31debc5e451d"} Jun 03 19:41:48.503305 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.503258 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-885bc" podStartSLOduration=66.503242179 podStartE2EDuration="1m6.503242179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:48.503131924 +0000 UTC m=+66.813289176" watchObservedRunningTime="2026-06-03 19:41:48.503242179 +0000 UTC m=+66.813399431" Jun 03 19:41:48.504650 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.504632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:48.504726 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.504672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:48.504762 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.504725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:48.504762 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.504754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:48.504834 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.504788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:48.504883 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.504837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:48.504883 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.504864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:48.505583 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.505539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-service-ca-bundle\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:48.507199 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.507169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed04c8db-bd0b-4bb0-858f-34e087e2d38d-metrics-certs\") pod \"router-default-6dfc6575cf-lqd8h\" (UID: \"ed04c8db-bd0b-4bb0-858f-34e087e2d38d\") " pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:48.507318 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.507180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a183de41-885c-4a77-9971-470bf0631bbd-metrics-tls\") pod \"dns-default-zxpgd\" (UID: \"a183de41-885c-4a77-9971-470bf0631bbd\") " pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:48.507470 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.507451 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5d43ce-cfc0-472a-a217-7a6e484feb81-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-tnllg\" (UID: \"7f5d43ce-cfc0-472a-a217-7a6e484feb81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:48.507579 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.507559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"image-registry-5bc994f9d6-srgr6\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:48.507722 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.507701 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a35794-56f3-42ab-af30-446edb2934be-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-8p6k4\" (UID: \"76a35794-56f3-42ab-af30-446edb2934be\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:48.507780 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.507703 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31999664-3290-426f-be81-720cc7036299-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xglz6\" (UID: \"31999664-3290-426f-be81-720cc7036299\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:48.686536 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.686502 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zksm4\"" Jun 03 19:41:48.694470 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.694439 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:48.696953 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.696928 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t5dn9\"" Jun 03 19:41:48.704873 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.704836 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" Jun 03 19:41:48.707086 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.707067 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nms7s\"" Jun 03 19:41:48.715011 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.714987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" Jun 03 19:41:48.748669 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.748376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rn4zh\"" Jun 03 19:41:48.756277 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.756227 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-plszr\"" Jun 03 19:41:48.759369 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.759106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:48.765855 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.764991 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vfft\"" Jun 03 19:41:48.765855 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.765207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" Jun 03 19:41:48.791257 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.784757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:48.916035 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.915997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc994f9d6-srgr6"] Jun 03 19:41:48.943614 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.943533 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-xglz6"] Jun 03 19:41:48.953203 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:48.953153 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31999664_3290_426f_be81_720cc7036299.slice/crio-e88377bc4f89d00bd7c5fceb3f6a285b4eb89cdf4ce979257a3795929a00b585 WatchSource:0}: Error finding container e88377bc4f89d00bd7c5fceb3f6a285b4eb89cdf4ce979257a3795929a00b585: Status 404 returned error can't find the container with id e88377bc4f89d00bd7c5fceb3f6a285b4eb89cdf4ce979257a3795929a00b585 Jun 03 19:41:48.974537 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:48.974503 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg"] Jun 03 19:41:49.034670 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.033292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4"] Jun 03 19:41:49.037127 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:49.037097 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a35794_56f3_42ab_af30_446edb2934be.slice/crio-4e2d882698306467b4b78e435a0367ae8ebe27ec1a0ba8f56afe70fb33b000fc WatchSource:0}: Error finding container 4e2d882698306467b4b78e435a0367ae8ebe27ec1a0ba8f56afe70fb33b000fc: Status 404 returned error can't find the container with id 4e2d882698306467b4b78e435a0367ae8ebe27ec1a0ba8f56afe70fb33b000fc Jun 03 19:41:49.059196 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.059124 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dfc6575cf-lqd8h"] Jun 03 19:41:49.062401 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:49.062370 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded04c8db_bd0b_4bb0_858f_34e087e2d38d.slice/crio-6e43898c74f4676efdaf02f7152ebe08de4c49f9233ec11a9ce882727a475cb7 WatchSource:0}: Error finding container 6e43898c74f4676efdaf02f7152ebe08de4c49f9233ec11a9ce882727a475cb7: Status 404 returned error can't find the container with id 6e43898c74f4676efdaf02f7152ebe08de4c49f9233ec11a9ce882727a475cb7 Jun 03 19:41:49.076206 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.076154 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxpgd"] Jun 03 19:41:49.080548 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:49.080521 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda183de41_885c_4a77_9971_470bf0631bbd.slice/crio-bf95b98cc9535e0e03d8adb62b6f49595b4b7971dd66e6bc810da3dc7f18fde7 WatchSource:0}: Error finding container bf95b98cc9535e0e03d8adb62b6f49595b4b7971dd66e6bc810da3dc7f18fde7: Status 404 returned error can't find the container with id bf95b98cc9535e0e03d8adb62b6f49595b4b7971dd66e6bc810da3dc7f18fde7 Jun 03 19:41:49.499995 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.499954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" event={"ID":"76a35794-56f3-42ab-af30-446edb2934be","Type":"ContainerStarted","Data":"4e2d882698306467b4b78e435a0367ae8ebe27ec1a0ba8f56afe70fb33b000fc"} Jun 03 19:41:49.501383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.501345 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" event={"ID":"31999664-3290-426f-be81-720cc7036299","Type":"ContainerStarted","Data":"e88377bc4f89d00bd7c5fceb3f6a285b4eb89cdf4ce979257a3795929a00b585"} Jun 03 19:41:49.503263 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.503233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" event={"ID":"11a6c421-1794-4d3b-994b-615041274c88","Type":"ContainerStarted","Data":"a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58"} Jun 03 19:41:49.503466 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.503440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" event={"ID":"11a6c421-1794-4d3b-994b-615041274c88","Type":"ContainerStarted","Data":"22eb77846018955b463b9185c011fb9a8f7835237fd64121f15a5b3f6dc08b0c"} Jun 03 19:41:49.503588 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.503480 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:41:49.504890 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.504837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxpgd" event={"ID":"a183de41-885c-4a77-9971-470bf0631bbd","Type":"ContainerStarted","Data":"bf95b98cc9535e0e03d8adb62b6f49595b4b7971dd66e6bc810da3dc7f18fde7"} Jun 03 19:41:49.506616 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.506585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" event={"ID":"ed04c8db-bd0b-4bb0-858f-34e087e2d38d","Type":"ContainerStarted","Data":"8939bfda5618a24321065a39be3214d28e7c6c7e2c99b217064d82fc4ad916bd"} Jun 03 19:41:49.506731 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.506635 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" event={"ID":"ed04c8db-bd0b-4bb0-858f-34e087e2d38d","Type":"ContainerStarted","Data":"6e43898c74f4676efdaf02f7152ebe08de4c49f9233ec11a9ce882727a475cb7"} Jun 03 19:41:49.508254 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.508231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" event={"ID":"7f5d43ce-cfc0-472a-a217-7a6e484feb81","Type":"ContainerStarted","Data":"6057bda794d729279300964125b27cae44723619a492481f46a5df8370132ffa"} Jun 03 19:41:49.522941 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.522895 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" podStartSLOduration=67.522881375 podStartE2EDuration="1m7.522881375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:49.522108855 +0000 UTC m=+67.832266106" watchObservedRunningTime="2026-06-03 19:41:49.522881375 +0000 UTC m=+67.833038663" Jun 03 19:41:49.538593 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.538537 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" podStartSLOduration=65.53851815 podStartE2EDuration="1m5.53851815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:49.538153875 +0000 UTC m=+67.848311126" watchObservedRunningTime="2026-06-03 19:41:49.53851815 +0000 UTC m=+67.848675403" Jun 03 19:41:49.760486 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.760380 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:49.766224 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:49.766005 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:50.517107 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:50.516293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82bwq" event={"ID":"36186242-9a2e-4793-90ec-518e85baecb3","Type":"ContainerStarted","Data":"c29ea0ce11b37a4c5a6ee5a1dfee64b7406b8e6b8c62703209e9b37bd33328eb"} Jun 03 19:41:50.517107 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:50.516557 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:50.517107 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:50.516596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82bwq" event={"ID":"36186242-9a2e-4793-90ec-518e85baecb3","Type":"ContainerStarted","Data":"91e68498a180e988dea97f7faf715fe3daa8ab567ec556a5525f13f42242ddd2"} Jun 03 19:41:50.518191 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:50.518148 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dfc6575cf-lqd8h" Jun 03 19:41:50.534258 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:50.533270 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82bwq" podStartSLOduration=67.228472428 podStartE2EDuration="1m8.533250077s" totalImagesPullingTime="1.304777649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:50.533072588 +0000 UTC m=+68.843229841" watchObservedRunningTime="2026-06-03 19:41:50.533250077 +0000 UTC m=+68.843407329" Jun 03 19:41:51.092733 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:51.092703 2562 scope.go:117] "RemoveContainer" containerID="614ba80719cc457aa094c285879883d67bda69bf7fb44b814ef44cc4d9166413" Jun 03 19:41:52.972068 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.970930 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2"] Jun 03 19:41:52.976561 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.974951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:52.979703 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.979429 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 19:41:52.979703 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.979603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2pj86\"" Jun 03 19:41:52.979917 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.979722 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 19:41:52.979917 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.979785 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 19:41:52.979917 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.979895 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 19:41:52.985109 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.984884 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r"] Jun 03 19:41:52.988465 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.988441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2"] Jun 03 19:41:52.989371 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.989330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:52.993695 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:52.993661 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 19:41:53.007527 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.006072 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds"] Jun 03 19:41:53.009788 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.009752 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r"] Jun 03 19:41:53.009899 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.009887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.012265 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.012213 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 19:41:53.012265 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.012246 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 19:41:53.012442 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.012403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 19:41:53.012442 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.012404 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 19:41:53.023476 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.023418 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds"] Jun 03 19:41:53.100351 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.100290 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nnd6t"] Jun 03 19:41:53.104221 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.104186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.109578 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.109556 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:41:53.109744 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.109660 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hfxqt\"" Jun 03 19:41:53.109894 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.109882 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:41:53.123505 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.123476 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nnd6t"] Jun 03 19:41:53.145757 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.145757 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8da2000c-f07f-4c70-aaf2-093c282b54dc-klusterlet-config\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-hub\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8da2000c-f07f-4c70-aaf2-093c282b54dc-tmp\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-ca\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfvcw\" (UniqueName: \"kubernetes.io/projected/8da2000c-f07f-4c70-aaf2-093c282b54dc-kube-api-access-xfvcw\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.145976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtgcw\" (UniqueName: \"kubernetes.io/projected/380eab54-0576-4be3-8c5b-75fe98f171f2-kube-api-access-wtgcw\") pod \"managed-serviceaccount-addon-agent-5fff8d494b-kmlt2\" (UID: \"380eab54-0576-4be3-8c5b-75fe98f171f2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.146003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd5pk\" (UniqueName: \"kubernetes.io/projected/0eedc24f-5afc-40d2-b592-2677140145ff-kube-api-access-wd5pk\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.146033 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.146026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/380eab54-0576-4be3-8c5b-75fe98f171f2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fff8d494b-kmlt2\" (UID: \"380eab54-0576-4be3-8c5b-75fe98f171f2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:53.146586 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.146066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eedc24f-5afc-40d2-b592-2677140145ff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.246899 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.246812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.246899 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.246862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-hub\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.247110 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.246899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a238fe31-e7a5-4e4a-97a3-6b10c2002780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.247110 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.246928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/a238fe31-e7a5-4e4a-97a3-6b10c2002780-kube-api-access-mqtsq\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.247110 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.246960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8da2000c-f07f-4c70-aaf2-093c282b54dc-tmp\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.247110 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-ca\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.247110 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvcw\" (UniqueName: \"kubernetes.io/projected/8da2000c-f07f-4c70-aaf2-093c282b54dc-kube-api-access-xfvcw\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.247110 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgcw\" (UniqueName: \"kubernetes.io/projected/380eab54-0576-4be3-8c5b-75fe98f171f2-kube-api-access-wtgcw\") pod \"managed-serviceaccount-addon-agent-5fff8d494b-kmlt2\" (UID: \"380eab54-0576-4be3-8c5b-75fe98f171f2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd5pk\" (UniqueName: \"kubernetes.io/projected/0eedc24f-5afc-40d2-b592-2677140145ff-kube-api-access-wd5pk\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/380eab54-0576-4be3-8c5b-75fe98f171f2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fff8d494b-kmlt2\" (UID: \"380eab54-0576-4be3-8c5b-75fe98f171f2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eedc24f-5afc-40d2-b592-2677140145ff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a238fe31-e7a5-4e4a-97a3-6b10c2002780-crio-socket\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a238fe31-e7a5-4e4a-97a3-6b10c2002780-data-volume\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8da2000c-f07f-4c70-aaf2-093c282b54dc-klusterlet-config\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8da2000c-f07f-4c70-aaf2-093c282b54dc-tmp\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.247383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.247361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a238fe31-e7a5-4e4a-97a3-6b10c2002780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.248194 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.248136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eedc24f-5afc-40d2-b592-2677140145ff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.250405 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.250380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-ca\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.250737 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.250701 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8da2000c-f07f-4c70-aaf2-093c282b54dc-klusterlet-config\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.250899 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.250801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-hub\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.251422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.251401 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.251513 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.251401 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/380eab54-0576-4be3-8c5b-75fe98f171f2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fff8d494b-kmlt2\" (UID: \"380eab54-0576-4be3-8c5b-75fe98f171f2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:53.251587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.251566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0eedc24f-5afc-40d2-b592-2677140145ff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.259640 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.259604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd5pk\" (UniqueName: \"kubernetes.io/projected/0eedc24f-5afc-40d2-b592-2677140145ff-kube-api-access-wd5pk\") pod \"cluster-proxy-proxy-agent-6d979b5f54-dbrds\" (UID: \"0eedc24f-5afc-40d2-b592-2677140145ff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.261648 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.261622 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtgcw\" (UniqueName: \"kubernetes.io/projected/380eab54-0576-4be3-8c5b-75fe98f171f2-kube-api-access-wtgcw\") pod \"managed-serviceaccount-addon-agent-5fff8d494b-kmlt2\" (UID: \"380eab54-0576-4be3-8c5b-75fe98f171f2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:53.263072 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.263052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfvcw\" (UniqueName: \"kubernetes.io/projected/8da2000c-f07f-4c70-aaf2-093c282b54dc-kube-api-access-xfvcw\") pod \"klusterlet-addon-workmgr-78456b4c65-r488r\" (UID: \"8da2000c-f07f-4c70-aaf2-093c282b54dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.297980 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.297940 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" Jun 03 19:41:53.310612 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.310587 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:41:53.322579 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.322548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" Jun 03 19:41:53.347781 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.347748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a238fe31-e7a5-4e4a-97a3-6b10c2002780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.347952 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.347788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/a238fe31-e7a5-4e4a-97a3-6b10c2002780-kube-api-access-mqtsq\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.347952 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.347851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a238fe31-e7a5-4e4a-97a3-6b10c2002780-crio-socket\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.347952 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.347886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a238fe31-e7a5-4e4a-97a3-6b10c2002780-data-volume\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.347952 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.347941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a238fe31-e7a5-4e4a-97a3-6b10c2002780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.348173 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.347955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a238fe31-e7a5-4e4a-97a3-6b10c2002780-crio-socket\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.348280 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.348261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a238fe31-e7a5-4e4a-97a3-6b10c2002780-data-volume\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.348556 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.348533 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a238fe31-e7a5-4e4a-97a3-6b10c2002780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.350299 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.350274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a238fe31-e7a5-4e4a-97a3-6b10c2002780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.359402 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.359379 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/a238fe31-e7a5-4e4a-97a3-6b10c2002780-kube-api-access-mqtsq\") pod \"insights-runtime-extractor-nnd6t\" (UID: \"a238fe31-e7a5-4e4a-97a3-6b10c2002780\") " pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:53.420732 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:53.420696 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nnd6t" Jun 03 19:41:54.040577 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.040506 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2"] Jun 03 19:41:54.064492 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:41:54.064443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod380eab54_0576_4be3_8c5b_75fe98f171f2.slice/crio-a06fa4f20b6b5b8f5ae032e1fdef24c0d1b769b73eb0d0d83707c79e9c952d42 WatchSource:0}: Error finding container a06fa4f20b6b5b8f5ae032e1fdef24c0d1b769b73eb0d0d83707c79e9c952d42: Status 404 returned error can't find the container with id a06fa4f20b6b5b8f5ae032e1fdef24c0d1b769b73eb0d0d83707c79e9c952d42 Jun 03 19:41:54.154020 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.153524 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds"] Jun 03 19:41:54.158515 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.158464 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r"] Jun 03 19:41:54.158718 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.158703 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nnd6t"] Jun 03 19:41:54.536228 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.536137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnd6t" event={"ID":"a238fe31-e7a5-4e4a-97a3-6b10c2002780","Type":"ContainerStarted","Data":"f8d2b68e8ce120926af509cee7f8862e02882fe0e060f2d105fc11e91442e314"} Jun 03 19:41:54.536228 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.536218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnd6t" event={"ID":"a238fe31-e7a5-4e4a-97a3-6b10c2002780","Type":"ContainerStarted","Data":"046743aba2bd25eb6105a9ad44a7f4abf874b15ea7a83f21fbb6e780090742c9"} Jun 03 19:41:54.537753 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.537712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" event={"ID":"380eab54-0576-4be3-8c5b-75fe98f171f2","Type":"ContainerStarted","Data":"a06fa4f20b6b5b8f5ae032e1fdef24c0d1b769b73eb0d0d83707c79e9c952d42"} Jun 03 19:41:54.539490 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.539443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5wkc" event={"ID":"ceb4dea7-8538-462d-92c9-3087b9d43c0c","Type":"ContainerStarted","Data":"3ee2876cff7b66f10528ad0c3e76738a886a3e14ec15c50d5ab623b894142f5b"} Jun 03 19:41:54.540996 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.540961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" event={"ID":"8da2000c-f07f-4c70-aaf2-093c282b54dc","Type":"ContainerStarted","Data":"b19088ba595b693349d2c51cc77be19f0aeebae9e1c5f1e6a3e009a009d97ef9"} Jun 03 19:41:54.543174 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.542933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" event={"ID":"76a35794-56f3-42ab-af30-446edb2934be","Type":"ContainerStarted","Data":"d5c0383e9fbd0f9f70300a5163d59828333d17fb67a600ab0bfedf1df98ac99b"} Jun 03 19:41:54.544974 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.544949 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" event={"ID":"31999664-3290-426f-be81-720cc7036299","Type":"ContainerStarted","Data":"f901bc7291eaa44cefa3430cd5292591a4a3d68f175fcc0ca1629d9b719b61b5"} Jun 03 19:41:54.547133 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.547114 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:41:54.547259 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.547193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" event={"ID":"557bfea7-56e5-499e-b18c-440c11f55d9f","Type":"ContainerStarted","Data":"c7f421d2cb7f23ad78179b9dced907f911d6f97cea07d7a8ad564655e3512bd2"} Jun 03 19:41:54.547785 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.547767 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:54.549009 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.548971 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" event={"ID":"0eedc24f-5afc-40d2-b592-2677140145ff","Type":"ContainerStarted","Data":"cc60d8a8e9f87333ca15a63d441ded1e2e14736cabe720124693aa9052c2abf2"} Jun 03 19:41:54.551212 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.551187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxpgd" event={"ID":"a183de41-885c-4a77-9971-470bf0631bbd","Type":"ContainerStarted","Data":"29c24afcdfea7040cfbd6a3582fcc0e0303074125e24989b0f0d3c9e3adf421b"} Jun 03 19:41:54.551359 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.551345 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxpgd" event={"ID":"a183de41-885c-4a77-9971-470bf0631bbd","Type":"ContainerStarted","Data":"670695151b575f1ec880e3e11497c4e1107e82b604db9d31551d969570b71ec8"} Jun 03 19:41:54.551466 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.551455 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zxpgd" Jun 03 19:41:54.553202 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.553183 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" event={"ID":"7f5d43ce-cfc0-472a-a217-7a6e484feb81","Type":"ContainerStarted","Data":"2439920f815afde2c87753cc88cee6419d39897f4f1a5cf1df85314645459194"} Jun 03 19:41:54.553371 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.553337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" event={"ID":"7f5d43ce-cfc0-472a-a217-7a6e484feb81","Type":"ContainerStarted","Data":"e9dd5817d9a7e179e104cff67497198105978bf191b2d113eb894fe362bbfe43"} Jun 03 19:41:54.558131 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.558084 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j5wkc" podStartSLOduration=66.951157856 podStartE2EDuration="1m12.558066744s" totalImagesPullingTime="5.606908888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:54.5566918 +0000 UTC m=+72.866849046" watchObservedRunningTime="2026-06-03 19:41:54.558066744 +0000 UTC m=+72.868223995" Jun 03 19:41:54.577280 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.577222 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-tnllg" podStartSLOduration=65.849054362 podStartE2EDuration="1m10.577210279s" totalImagesPullingTime="4.728155917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:54.576207228 +0000 UTC m=+72.886364479" watchObservedRunningTime="2026-06-03 19:41:54.577210279 +0000 UTC m=+72.887367530" Jun 03 19:41:54.596803 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.596750 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-xglz6" podStartSLOduration=65.789817166 podStartE2EDuration="1m10.596731922s" totalImagesPullingTime="4.806914756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:54.595640115 +0000 UTC m=+72.905797383" watchObservedRunningTime="2026-06-03 19:41:54.596731922 +0000 UTC m=+72.906889173" Jun 03 19:41:54.623783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.623600 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zxpgd" podStartSLOduration=33.941712778 podStartE2EDuration="38.623580342s" totalImagesPullingTime="4.681867564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:54.622944042 +0000 UTC m=+72.933101295" watchObservedRunningTime="2026-06-03 19:41:54.623580342 +0000 UTC m=+72.933737594" Jun 03 19:41:54.642258 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.642202 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" podStartSLOduration=61.460925923 podStartE2EDuration="1m10.642182565s" totalImagesPullingTime="9.181256642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:54.64126752 +0000 UTC m=+72.951424771" watchObservedRunningTime="2026-06-03 19:41:54.642182565 +0000 UTC m=+72.952339819" Jun 03 19:41:54.659901 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.659858 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-8p6k4" podStartSLOduration=65.926386036 podStartE2EDuration="1m10.659842817s" totalImagesPullingTime="4.733456781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:54.658971203 +0000 UTC m=+72.969128457" watchObservedRunningTime="2026-06-03 19:41:54.659842817 +0000 UTC m=+72.970000067" Jun 03 19:41:54.835783 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:54.835639 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-p7qjt" Jun 03 19:41:56.572988 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:41:56.572815 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnd6t" event={"ID":"a238fe31-e7a5-4e4a-97a3-6b10c2002780","Type":"ContainerStarted","Data":"a7616c5a13c22c8b5a8d65d44806182a42a7500dda939fbdc7368e3616a297c3"} Jun 03 19:42:02.598881 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:02.598844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" event={"ID":"380eab54-0576-4be3-8c5b-75fe98f171f2","Type":"ContainerStarted","Data":"1848496a2a606f03ee9ec3891239b68d45a6ee76dd97f437cd28040bb9fdef55"} Jun 03 19:42:02.600374 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:02.600345 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" event={"ID":"8da2000c-f07f-4c70-aaf2-093c282b54dc","Type":"ContainerStarted","Data":"cc56d8532dc3d895675f183bd820408dc2839e8f06a7fdf9ac4abcf0a595ebb3"} Jun 03 19:42:02.600551 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:02.600533 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:42:02.602103 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:02.602078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" event={"ID":"0eedc24f-5afc-40d2-b592-2677140145ff","Type":"ContainerStarted","Data":"ef8cf263abd546ad0fbe3cc9b16966b10fc79e01b85234a0ddfa1024982655f8"} Jun 03 19:42:02.602354 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:02.602334 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" Jun 03 19:42:02.615986 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:02.615937 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fff8d494b-kmlt2" podStartSLOduration=2.3094449790000002 podStartE2EDuration="10.61592266s" totalImagesPullingTime="8.306477681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:02.615196441 +0000 UTC m=+80.925353692" watchObservedRunningTime="2026-06-03 19:42:02.61592266 +0000 UTC m=+80.926079910" Jun 03 19:42:02.633312 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:02.633239 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78456b4c65-r488r" podStartSLOduration=2.423309897 podStartE2EDuration="10.633223759s" totalImagesPullingTime="8.209913862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:02.63190578 +0000 UTC m=+80.942063030" watchObservedRunningTime="2026-06-03 19:42:02.633223759 +0000 UTC m=+80.943381009" Jun 03 19:42:03.608546 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:03.608505 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" event={"ID":"0eedc24f-5afc-40d2-b592-2677140145ff","Type":"ContainerStarted","Data":"612d93cf1d965f35877b826f591d9615400773679ba4decb325355a7df505fa7"} Jun 03 19:42:03.609062 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:03.608556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" event={"ID":"0eedc24f-5afc-40d2-b592-2677140145ff","Type":"ContainerStarted","Data":"641a7e09f681432597f15d270833e676a52937341c6968fa784b71b97d0bcfac"} Jun 03 19:42:03.610544 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:03.610519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnd6t" event={"ID":"a238fe31-e7a5-4e4a-97a3-6b10c2002780","Type":"ContainerStarted","Data":"d660dc76880ba7888c229cd435bf9ade0191b8dcc1a4f377dc6d20f190dddd02"} Jun 03 19:42:03.630308 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:03.630261 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d979b5f54-dbrds" podStartSLOduration=3.420077705 podStartE2EDuration="11.630245815s" totalImagesPullingTime="8.21016811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:03.629391048 +0000 UTC m=+81.939548301" watchObservedRunningTime="2026-06-03 19:42:03.630245815 +0000 UTC m=+81.940403146" Jun 03 19:42:03.647072 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:03.647003 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nnd6t" podStartSLOduration=2.4876354640000002 podStartE2EDuration="10.646956441s" totalImagesPullingTime="8.159320977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:03.646489718 +0000 UTC m=+81.956646970" watchObservedRunningTime="2026-06-03 19:42:03.646956441 +0000 UTC m=+81.957113696" Jun 03 19:42:04.120792 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.120754 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-696s4"] Jun 03 19:42:04.124157 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.124134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.126330 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.126306 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:42:04.126804 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.126784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:42:04.126925 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.126859 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:42:04.127001 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.126985 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:42:04.127225 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.127070 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b5422\"" Jun 03 19:42:04.150117 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-tls\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150248 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-root\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150248 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150336 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-wtmp\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150336 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqtq\" (UniqueName: \"kubernetes.io/projected/2e9a65c2-63af-4e4e-b810-0d14d33a9249-kube-api-access-lhqtq\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150410 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-sys\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-textfile\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150483 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-accelerators-collector-config\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.150519 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.150509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9a65c2-63af-4e4e-b810-0d14d33a9249-metrics-client-ca\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251006 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.250958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqtq\" (UniqueName: \"kubernetes.io/projected/2e9a65c2-63af-4e4e-b810-0d14d33a9249-kube-api-access-lhqtq\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251185 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-sys\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251185 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-textfile\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251185 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-accelerators-collector-config\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251185 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9a65c2-63af-4e4e-b810-0d14d33a9249-metrics-client-ca\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251185 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-tls\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251427 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-root\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251427 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251427 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-wtmp\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251587 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251435 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-wtmp\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251587 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:42:04.251536 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 19:42:04.251709 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:42:04.251591 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-tls podName:2e9a65c2-63af-4e4e-b810-0d14d33a9249 nodeName:}" failed. No retries permitted until 2026-06-03 19:42:04.751572352 +0000 UTC m=+83.061729584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-tls") pod "node-exporter-696s4" (UID: "2e9a65c2-63af-4e4e-b810-0d14d33a9249") : secret "node-exporter-tls" not found Jun 03 19:42:04.251875 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-root\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.251965 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.251946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9a65c2-63af-4e4e-b810-0d14d33a9249-metrics-client-ca\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.252031 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.252018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9a65c2-63af-4e4e-b810-0d14d33a9249-sys\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.252253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.252234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-textfile\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.252781 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.252752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-accelerators-collector-config\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.254731 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.254707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.263585 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.263562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqtq\" (UniqueName: \"kubernetes.io/projected/2e9a65c2-63af-4e4e-b810-0d14d33a9249-kube-api-access-lhqtq\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.563795 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.563696 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zxpgd" Jun 03 19:42:04.755692 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.755654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-tls\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:04.758075 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:04.758050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9a65c2-63af-4e4e-b810-0d14d33a9249-node-exporter-tls\") pod \"node-exporter-696s4\" (UID: \"2e9a65c2-63af-4e4e-b810-0d14d33a9249\") " pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:05.036346 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:05.036310 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-696s4" Jun 03 19:42:05.626893 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:05.626850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-696s4" event={"ID":"2e9a65c2-63af-4e4e-b810-0d14d33a9249","Type":"ContainerStarted","Data":"b1f1c7e4544bebfa8037919d4148afad57aa3bccb31dddc550b04a363bbc1153"} Jun 03 19:42:06.633133 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:06.633096 2562 generic.go:356] "Generic (PLEG): container finished" podID="2e9a65c2-63af-4e4e-b810-0d14d33a9249" containerID="98ea1c4128a36146a7365eb6c47cb270767dd5d9891a80121082540ce782ee4d" exitCode=0 Jun 03 19:42:06.633565 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:06.633186 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-696s4" event={"ID":"2e9a65c2-63af-4e4e-b810-0d14d33a9249","Type":"ContainerDied","Data":"98ea1c4128a36146a7365eb6c47cb270767dd5d9891a80121082540ce782ee4d"} Jun 03 19:42:07.639324 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:07.639291 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-696s4" event={"ID":"2e9a65c2-63af-4e4e-b810-0d14d33a9249","Type":"ContainerStarted","Data":"fd502aa4da43d5c2b8b206c1ba44dea90d09560e0da621e779b041abc23cbdd8"} Jun 03 19:42:07.639761 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:07.639346 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-696s4" event={"ID":"2e9a65c2-63af-4e4e-b810-0d14d33a9249","Type":"ContainerStarted","Data":"8efde904bb5586d4971db481bb0c35cd3d802333437a31ee96df8a9f38fa489c"} Jun 03 19:42:07.659960 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:07.659916 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-696s4" podStartSLOduration=2.8210193500000003 podStartE2EDuration="3.659901999s" totalImagesPullingTime="774.561379ms" totalInitContainerRuntime="64.32127ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:07.65927006 +0000 UTC m=+85.969427311" watchObservedRunningTime="2026-06-03 19:42:07.659901999 +0000 UTC m=+85.970059250" Jun 03 19:42:08.698429 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:08.698393 2562 patch_prober.go:28] interesting pod/image-registry-5bc994f9d6-srgr6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 19:42:08.698898 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:08.698448 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" podUID="11a6c421-1794-4d3b-994b-615041274c88" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:42:10.520295 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:10.520267 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:42:16.230805 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:16.230770 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bc994f9d6-srgr6"] Jun 03 19:42:19.511249 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:19.511218 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-885bc" Jun 03 19:42:37.756589 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:37.756553 2562 generic.go:356] "Generic (PLEG): container finished" podID="a9e4caa0-abb4-42c3-a210-dce9c17caa66" containerID="77a1c1684e4d176a25354c067255cf857dd04fc153927c97d1f67528d5d34784" exitCode=0 Jun 03 19:42:37.757042 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:37.756630 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" event={"ID":"a9e4caa0-abb4-42c3-a210-dce9c17caa66","Type":"ContainerDied","Data":"77a1c1684e4d176a25354c067255cf857dd04fc153927c97d1f67528d5d34784"} Jun 03 19:42:37.757042 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:37.756952 2562 scope.go:117] "RemoveContainer" containerID="77a1c1684e4d176a25354c067255cf857dd04fc153927c97d1f67528d5d34784" Jun 03 19:42:38.762374 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:38.762342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-nt95z" event={"ID":"a9e4caa0-abb4-42c3-a210-dce9c17caa66","Type":"ContainerStarted","Data":"77638dd6d2194330cc356180e66d6c4c96dcde6001fae2a34c42e30384e4326f"} Jun 03 19:42:41.250436 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.250389 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" podUID="11a6c421-1794-4d3b-994b-615041274c88" containerName="registry" containerID="cri-o://a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58" gracePeriod=30 Jun 03 19:42:41.492028 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.492004 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:42:41.668062 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668026 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668062 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668070 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-trusted-ca\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668326 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668108 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-installation-pull-secrets\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668326 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668132 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-registry-certificates\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668326 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668155 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-bound-sa-token\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668477 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668332 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw89r\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-kube-api-access-kw89r\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668477 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668373 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6c421-1794-4d3b-994b-615041274c88-ca-trust-extracted\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668477 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668401 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-image-registry-private-configuration\") pod \"11a6c421-1794-4d3b-994b-615041274c88\" (UID: \"11a6c421-1794-4d3b-994b-615041274c88\") " Jun 03 19:42:41.668786 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668748 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:42:41.668913 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.668799 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:42:41.670673 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.670640 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:42:41.670894 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.670867 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:41.670998 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.670962 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:41.671240 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.671103 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:42:41.671313 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.671259 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-kube-api-access-kw89r" (OuterVolumeSpecName: "kube-api-access-kw89r") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "kube-api-access-kw89r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:41.676975 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.676947 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a6c421-1794-4d3b-994b-615041274c88-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "11a6c421-1794-4d3b-994b-615041274c88" (UID: "11a6c421-1794-4d3b-994b-615041274c88"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:42:41.769880 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769844 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-bound-sa-token\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.769880 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769872 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw89r\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-kube-api-access-kw89r\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.769880 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769883 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6c421-1794-4d3b-994b-615041274c88-ca-trust-extracted\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.770171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769894 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-image-registry-private-configuration\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.770171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769903 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6c421-1794-4d3b-994b-615041274c88-registry-tls\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.770171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769911 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-trusted-ca\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.770171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769919 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6c421-1794-4d3b-994b-615041274c88-installation-pull-secrets\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.770171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.769928 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6c421-1794-4d3b-994b-615041274c88-registry-certificates\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:42:41.774771 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.774738 2562 generic.go:356] "Generic (PLEG): container finished" podID="11a6c421-1794-4d3b-994b-615041274c88" containerID="a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58" exitCode=0 Jun 03 19:42:41.774883 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.774802 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" Jun 03 19:42:41.774883 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.774824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" event={"ID":"11a6c421-1794-4d3b-994b-615041274c88","Type":"ContainerDied","Data":"a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58"} Jun 03 19:42:41.774951 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.774901 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc994f9d6-srgr6" event={"ID":"11a6c421-1794-4d3b-994b-615041274c88","Type":"ContainerDied","Data":"22eb77846018955b463b9185c011fb9a8f7835237fd64121f15a5b3f6dc08b0c"} Jun 03 19:42:41.774951 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.774923 2562 scope.go:117] "RemoveContainer" containerID="a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58" Jun 03 19:42:41.783276 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.783260 2562 scope.go:117] "RemoveContainer" containerID="a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58" Jun 03 19:42:41.783524 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:42:41.783505 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58\": container with ID starting with a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58 not found: ID does not exist" containerID="a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58" Jun 03 19:42:41.783568 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.783531 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58"} err="failed to get container status \"a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58\": rpc error: code = NotFound desc = could not find container \"a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58\": container with ID starting with a65cd732b62e59371b144bb338493262fed142074bf5ecbaff3745a450537e58 not found: ID does not exist" Jun 03 19:42:41.796611 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.796589 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bc994f9d6-srgr6"] Jun 03 19:42:41.799793 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:41.799770 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bc994f9d6-srgr6"] Jun 03 19:42:42.098461 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:42.098431 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a6c421-1794-4d3b-994b-615041274c88" path="/var/lib/kubelet/pods/11a6c421-1794-4d3b-994b-615041274c88/volumes" Jun 03 19:42:48.800850 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:48.800809 2562 generic.go:356] "Generic (PLEG): container finished" podID="fc70db4a-592a-4944-9898-17be786a2c21" containerID="269d28d0e1553bf4517b193b5240659eb00695ae7d601f6cbe64db24ce1a4865" exitCode=0 Jun 03 19:42:48.801217 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:48.800887 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" event={"ID":"fc70db4a-592a-4944-9898-17be786a2c21","Type":"ContainerDied","Data":"269d28d0e1553bf4517b193b5240659eb00695ae7d601f6cbe64db24ce1a4865"} Jun 03 19:42:48.801258 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:48.801242 2562 scope.go:117] "RemoveContainer" containerID="269d28d0e1553bf4517b193b5240659eb00695ae7d601f6cbe64db24ce1a4865" Jun 03 19:42:49.806607 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:49.806569 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9" event={"ID":"fc70db4a-592a-4944-9898-17be786a2c21","Type":"ContainerStarted","Data":"09da58f9c270739b251c77ee1a6da26131f414b3dae29290e3f0dbb423195164"} Jun 03 19:42:52.817943 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:52.817907 2562 generic.go:356] "Generic (PLEG): container finished" podID="0f463e3a-575a-4f0e-a204-d3a807cdc361" containerID="055b9f4d8e36ff865b97039e2420f3dbf3f3be97fd76721fca6ca7616c58de1f" exitCode=0 Jun 03 19:42:52.818405 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:52.817970 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mm7qk" event={"ID":"0f463e3a-575a-4f0e-a204-d3a807cdc361","Type":"ContainerDied","Data":"055b9f4d8e36ff865b97039e2420f3dbf3f3be97fd76721fca6ca7616c58de1f"} Jun 03 19:42:52.818405 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:52.818380 2562 scope.go:117] "RemoveContainer" containerID="055b9f4d8e36ff865b97039e2420f3dbf3f3be97fd76721fca6ca7616c58de1f" Jun 03 19:42:53.823576 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:42:53.823542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mm7qk" event={"ID":"0f463e3a-575a-4f0e-a204-d3a807cdc361","Type":"ContainerStarted","Data":"66ac89118527f1dc518961f709ab1b60510d8f6067d3b2761000638ac6e2d72e"} Jun 03 19:45:42.035431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:45:42.035403 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:45:42.036118 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:45:42.036090 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:45:42.054724 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:45:42.054701 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:46:09.294034 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.294001 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf"] Jun 03 19:46:09.296321 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.294300 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a6c421-1794-4d3b-994b-615041274c88" containerName="registry" Jun 03 19:46:09.296321 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.294311 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a6c421-1794-4d3b-994b-615041274c88" containerName="registry" Jun 03 19:46:09.296321 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.294366 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a6c421-1794-4d3b-994b-615041274c88" containerName="registry" Jun 03 19:46:09.297175 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.297160 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.301113 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.301093 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:46:09.301539 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.301522 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:46:09.301598 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.301521 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5rddl\"" Jun 03 19:46:09.301665 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.301647 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:46:09.301802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.301786 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:46:09.319696 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.319658 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf"] Jun 03 19:46:09.398568 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.398531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef1e7268-b764-4c40-b240-d3f7280e1f32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.398765 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.398582 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef1e7268-b764-4c40-b240-d3f7280e1f32-manifests\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.398765 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.398712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef1e7268-b764-4c40-b240-d3f7280e1f32-tmp\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.398765 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.398742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzlb6\" (UniqueName: \"kubernetes.io/projected/ef1e7268-b764-4c40-b240-d3f7280e1f32-kube-api-access-vzlb6\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.398878 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.398774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef1e7268-b764-4c40-b240-d3f7280e1f32-webhook-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.500018 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.499975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef1e7268-b764-4c40-b240-d3f7280e1f32-manifests\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.500186 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.500145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef1e7268-b764-4c40-b240-d3f7280e1f32-tmp\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.500232 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.500190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzlb6\" (UniqueName: \"kubernetes.io/projected/ef1e7268-b764-4c40-b240-d3f7280e1f32-kube-api-access-vzlb6\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.500267 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.500231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef1e7268-b764-4c40-b240-d3f7280e1f32-webhook-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.500301 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.500272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef1e7268-b764-4c40-b240-d3f7280e1f32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.500450 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.500431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef1e7268-b764-4c40-b240-d3f7280e1f32-manifests\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.502390 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.502362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef1e7268-b764-4c40-b240-d3f7280e1f32-tmp\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.502582 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.502563 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef1e7268-b764-4c40-b240-d3f7280e1f32-webhook-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.502623 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.502586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef1e7268-b764-4c40-b240-d3f7280e1f32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.507909 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.507892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzlb6\" (UniqueName: \"kubernetes.io/projected/ef1e7268-b764-4c40-b240-d3f7280e1f32-kube-api-access-vzlb6\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-cxfjf\" (UID: \"ef1e7268-b764-4c40-b240-d3f7280e1f32\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.607097 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.607064 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:09.774741 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:09.774711 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1e7268_b764_4c40_b240_d3f7280e1f32.slice/crio-ab220668b4a4f4eb6f51f6e1b81bb27782b0a5ea5b0c51238c5c567c6a9ecb4c WatchSource:0}: Error finding container ab220668b4a4f4eb6f51f6e1b81bb27782b0a5ea5b0c51238c5c567c6a9ecb4c: Status 404 returned error can't find the container with id ab220668b4a4f4eb6f51f6e1b81bb27782b0a5ea5b0c51238c5c567c6a9ecb4c Jun 03 19:46:09.776484 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.776463 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:46:09.787151 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:09.787124 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf"] Jun 03 19:46:10.570408 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:10.570371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" event={"ID":"ef1e7268-b764-4c40-b240-d3f7280e1f32","Type":"ContainerStarted","Data":"ab220668b4a4f4eb6f51f6e1b81bb27782b0a5ea5b0c51238c5c567c6a9ecb4c"} Jun 03 19:46:13.584011 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:13.583973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" event={"ID":"ef1e7268-b764-4c40-b240-d3f7280e1f32","Type":"ContainerStarted","Data":"d6e3214833a039ad3e4268413c7340bd595cf4474941e0decd387edec2e1a77c"} Jun 03 19:46:14.589381 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:14.589344 2562 generic.go:356] "Generic (PLEG): container finished" podID="ef1e7268-b764-4c40-b240-d3f7280e1f32" containerID="d6e3214833a039ad3e4268413c7340bd595cf4474941e0decd387edec2e1a77c" exitCode=0 Jun 03 19:46:14.589792 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:14.589411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" event={"ID":"ef1e7268-b764-4c40-b240-d3f7280e1f32","Type":"ContainerDied","Data":"d6e3214833a039ad3e4268413c7340bd595cf4474941e0decd387edec2e1a77c"} Jun 03 19:46:15.595672 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:15.595637 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" event={"ID":"ef1e7268-b764-4c40-b240-d3f7280e1f32","Type":"ContainerStarted","Data":"a06b99d302f25ddb9dc3cfa4e2bb3ba3d6d0d9439c2b152c76f69b56ffa5ff62"} Jun 03 19:46:15.596158 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:15.595797 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:15.618953 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:15.618912 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" podStartSLOduration=2.458526441 podStartE2EDuration="6.618898348s" totalImagesPullingTime="3.14050992s" totalInitContainerRuntime="1.019861987s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:15.617600202 +0000 UTC m=+333.927757453" watchObservedRunningTime="2026-06-03 19:46:15.618898348 +0000 UTC m=+333.929055598" Jun 03 19:46:26.601801 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:26.601769 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-cxfjf" Jun 03 19:46:29.009927 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.009892 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d59cb7674-8px64"] Jun 03 19:46:29.020876 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.020850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.023480 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.023448 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 19:46:29.024367 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.024341 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fh9kr\"" Jun 03 19:46:29.024615 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.024599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 19:46:29.026527 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.026462 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d59cb7674-8px64"] Jun 03 19:46:29.060195 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.060159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pdk\" (UniqueName: \"kubernetes.io/projected/a5a44de9-f948-41e2-9750-cd45258217a7-kube-api-access-h7pdk\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.060374 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.060209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5a44de9-f948-41e2-9750-cd45258217a7-tls-certs\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.060374 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.060241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5a44de9-f948-41e2-9750-cd45258217a7-tmp\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.115668 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.115631 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-xcbkd"] Jun 03 19:46:29.118819 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.118801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.121302 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.121274 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 19:46:29.121708 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.121690 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r5pvs\"" Jun 03 19:46:29.129289 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.129268 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-xcbkd"] Jun 03 19:46:29.161053 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.161019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pdk\" (UniqueName: \"kubernetes.io/projected/a5a44de9-f948-41e2-9750-cd45258217a7-kube-api-access-h7pdk\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.161235 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.161082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5a44de9-f948-41e2-9750-cd45258217a7-tls-certs\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.161235 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.161115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5a44de9-f948-41e2-9750-cd45258217a7-tmp\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.161235 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.161154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fef3c6f-14ba-43ce-92fd-df4806cc6193-cert\") pod \"odh-model-controller-6dc94f689f-xcbkd\" (UID: \"7fef3c6f-14ba-43ce-92fd-df4806cc6193\") " pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.161235 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.161193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frhsn\" (UniqueName: \"kubernetes.io/projected/7fef3c6f-14ba-43ce-92fd-df4806cc6193-kube-api-access-frhsn\") pod \"odh-model-controller-6dc94f689f-xcbkd\" (UID: \"7fef3c6f-14ba-43ce-92fd-df4806cc6193\") " pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.163422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.163392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5a44de9-f948-41e2-9750-cd45258217a7-tmp\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.163610 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.163593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5a44de9-f948-41e2-9750-cd45258217a7-tls-certs\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.172047 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.172022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pdk\" (UniqueName: \"kubernetes.io/projected/a5a44de9-f948-41e2-9750-cd45258217a7-kube-api-access-h7pdk\") pod \"kube-auth-proxy-6d59cb7674-8px64\" (UID: \"a5a44de9-f948-41e2-9750-cd45258217a7\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.262357 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.262261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fef3c6f-14ba-43ce-92fd-df4806cc6193-cert\") pod \"odh-model-controller-6dc94f689f-xcbkd\" (UID: \"7fef3c6f-14ba-43ce-92fd-df4806cc6193\") " pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.262357 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.262316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frhsn\" (UniqueName: \"kubernetes.io/projected/7fef3c6f-14ba-43ce-92fd-df4806cc6193-kube-api-access-frhsn\") pod \"odh-model-controller-6dc94f689f-xcbkd\" (UID: \"7fef3c6f-14ba-43ce-92fd-df4806cc6193\") " pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.262538 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:46:29.262404 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 19:46:29.262538 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:46:29.262482 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fef3c6f-14ba-43ce-92fd-df4806cc6193-cert podName:7fef3c6f-14ba-43ce-92fd-df4806cc6193 nodeName:}" failed. No retries permitted until 2026-06-03 19:46:29.762465782 +0000 UTC m=+348.072623014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7fef3c6f-14ba-43ce-92fd-df4806cc6193-cert") pod "odh-model-controller-6dc94f689f-xcbkd" (UID: "7fef3c6f-14ba-43ce-92fd-df4806cc6193") : secret "odh-model-controller-webhook-cert" not found Jun 03 19:46:29.273570 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.273545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frhsn\" (UniqueName: \"kubernetes.io/projected/7fef3c6f-14ba-43ce-92fd-df4806cc6193-kube-api-access-frhsn\") pod \"odh-model-controller-6dc94f689f-xcbkd\" (UID: \"7fef3c6f-14ba-43ce-92fd-df4806cc6193\") " pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.332241 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.332203 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" Jun 03 19:46:29.477528 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.477503 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d59cb7674-8px64"] Jun 03 19:46:29.479275 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:29.479246 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a44de9_f948_41e2_9750_cd45258217a7.slice/crio-a9d71a266eef2cb082103284bba8c3d809e7d8cab6df0461f33aad362a355795 WatchSource:0}: Error finding container a9d71a266eef2cb082103284bba8c3d809e7d8cab6df0461f33aad362a355795: Status 404 returned error can't find the container with id a9d71a266eef2cb082103284bba8c3d809e7d8cab6df0461f33aad362a355795 Jun 03 19:46:29.656373 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.656338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" event={"ID":"a5a44de9-f948-41e2-9750-cd45258217a7","Type":"ContainerStarted","Data":"a9d71a266eef2cb082103284bba8c3d809e7d8cab6df0461f33aad362a355795"} Jun 03 19:46:29.768141 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.768101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fef3c6f-14ba-43ce-92fd-df4806cc6193-cert\") pod \"odh-model-controller-6dc94f689f-xcbkd\" (UID: \"7fef3c6f-14ba-43ce-92fd-df4806cc6193\") " pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.770582 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.770559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fef3c6f-14ba-43ce-92fd-df4806cc6193-cert\") pod \"odh-model-controller-6dc94f689f-xcbkd\" (UID: \"7fef3c6f-14ba-43ce-92fd-df4806cc6193\") " pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:29.822408 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.822374 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6dchl"] Jun 03 19:46:29.826992 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.826967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:29.829928 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.829901 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 19:46:29.839367 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.839342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6dchl"] Jun 03 19:46:29.868663 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.868627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12ef131c-061a-4103-b05a-f3cae690ad81-tls-certs\") pod \"model-serving-api-5dd488fc48-6dchl\" (UID: \"12ef131c-061a-4103-b05a-f3cae690ad81\") " pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:29.868836 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.868716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmhm\" (UniqueName: \"kubernetes.io/projected/12ef131c-061a-4103-b05a-f3cae690ad81-kube-api-access-6gmhm\") pod \"model-serving-api-5dd488fc48-6dchl\" (UID: \"12ef131c-061a-4103-b05a-f3cae690ad81\") " pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:29.969993 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.969893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12ef131c-061a-4103-b05a-f3cae690ad81-tls-certs\") pod \"model-serving-api-5dd488fc48-6dchl\" (UID: \"12ef131c-061a-4103-b05a-f3cae690ad81\") " pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:29.969993 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.969978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmhm\" (UniqueName: \"kubernetes.io/projected/12ef131c-061a-4103-b05a-f3cae690ad81-kube-api-access-6gmhm\") pod \"model-serving-api-5dd488fc48-6dchl\" (UID: \"12ef131c-061a-4103-b05a-f3cae690ad81\") " pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:29.970195 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:46:29.970042 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 03 19:46:29.970195 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:46:29.970105 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ef131c-061a-4103-b05a-f3cae690ad81-tls-certs podName:12ef131c-061a-4103-b05a-f3cae690ad81 nodeName:}" failed. No retries permitted until 2026-06-03 19:46:30.470089397 +0000 UTC m=+348.780246629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/12ef131c-061a-4103-b05a-f3cae690ad81-tls-certs") pod "model-serving-api-5dd488fc48-6dchl" (UID: "12ef131c-061a-4103-b05a-f3cae690ad81") : secret "model-serving-api-tls" not found Jun 03 19:46:29.980212 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:29.980184 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmhm\" (UniqueName: \"kubernetes.io/projected/12ef131c-061a-4103-b05a-f3cae690ad81-kube-api-access-6gmhm\") pod \"model-serving-api-5dd488fc48-6dchl\" (UID: \"12ef131c-061a-4103-b05a-f3cae690ad81\") " pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:30.029232 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:30.029201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:30.199794 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:30.199745 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-xcbkd"] Jun 03 19:46:30.204127 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:30.204092 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fef3c6f_14ba_43ce_92fd_df4806cc6193.slice/crio-3e424033d4e56e5ed52451862c261b5f21190f03079334af23d56b2228858a02 WatchSource:0}: Error finding container 3e424033d4e56e5ed52451862c261b5f21190f03079334af23d56b2228858a02: Status 404 returned error can't find the container with id 3e424033d4e56e5ed52451862c261b5f21190f03079334af23d56b2228858a02 Jun 03 19:46:30.479146 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:30.479106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12ef131c-061a-4103-b05a-f3cae690ad81-tls-certs\") pod \"model-serving-api-5dd488fc48-6dchl\" (UID: \"12ef131c-061a-4103-b05a-f3cae690ad81\") " pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:30.482327 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:30.482301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12ef131c-061a-4103-b05a-f3cae690ad81-tls-certs\") pod \"model-serving-api-5dd488fc48-6dchl\" (UID: \"12ef131c-061a-4103-b05a-f3cae690ad81\") " pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:30.665101 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:30.665061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" event={"ID":"7fef3c6f-14ba-43ce-92fd-df4806cc6193","Type":"ContainerStarted","Data":"3e424033d4e56e5ed52451862c261b5f21190f03079334af23d56b2228858a02"} Jun 03 19:46:30.737669 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:30.737586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:30.902558 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:30.901552 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6dchl"] Jun 03 19:46:30.905542 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:30.904916 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ef131c_061a_4103_b05a_f3cae690ad81.slice/crio-28ec0fdf6a54e175ec81bcc944f4427abb29403263c7f912d44bfe855aec795d WatchSource:0}: Error finding container 28ec0fdf6a54e175ec81bcc944f4427abb29403263c7f912d44bfe855aec795d: Status 404 returned error can't find the container with id 28ec0fdf6a54e175ec81bcc944f4427abb29403263c7f912d44bfe855aec795d Jun 03 19:46:31.672166 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:31.672115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6dchl" event={"ID":"12ef131c-061a-4103-b05a-f3cae690ad81","Type":"ContainerStarted","Data":"28ec0fdf6a54e175ec81bcc944f4427abb29403263c7f912d44bfe855aec795d"} Jun 03 19:46:34.687445 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.687410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6dchl" event={"ID":"12ef131c-061a-4103-b05a-f3cae690ad81","Type":"ContainerStarted","Data":"2ffcd08a71e483648c61db71e9091027c3da6884255344bfe3b2ee8288bad5ca"} Jun 03 19:46:34.687909 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.687481 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:34.688912 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.688889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" event={"ID":"a5a44de9-f948-41e2-9750-cd45258217a7","Type":"ContainerStarted","Data":"33db807a14728dbd02c2bb3471ecc9be5a2aeb885bf2a06a285baf9b775f1a67"} Jun 03 19:46:34.690213 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.690193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" event={"ID":"7fef3c6f-14ba-43ce-92fd-df4806cc6193","Type":"ContainerStarted","Data":"860df653a61224dca88af8731a3a563b2bb6a57dff3ae153d1809972fd736e52"} Jun 03 19:46:34.690311 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.690297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:34.705042 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.704998 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-6dchl" podStartSLOduration=2.37158463 podStartE2EDuration="5.704984692s" totalImagesPullingTime="3.333400062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:34.703658182 +0000 UTC m=+353.013815433" watchObservedRunningTime="2026-06-03 19:46:34.704984692 +0000 UTC m=+353.015141942" Jun 03 19:46:34.720811 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.720769 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-8px64" podStartSLOduration=2.412885044 podStartE2EDuration="6.720755523s" totalImagesPullingTime="4.307870479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:34.719130688 +0000 UTC m=+353.029287939" watchObservedRunningTime="2026-06-03 19:46:34.720755523 +0000 UTC m=+353.030912795" Jun 03 19:46:34.735316 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:34.735273 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" podStartSLOduration=2.118117041 podStartE2EDuration="5.73525889s" totalImagesPullingTime="3.617141849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:34.734813664 +0000 UTC m=+353.044970916" watchObservedRunningTime="2026-06-03 19:46:34.73525889 +0000 UTC m=+353.045416141" Jun 03 19:46:39.951838 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.951799 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hsdmq"] Jun 03 19:46:39.954755 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.954722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:39.959058 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.959037 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8lthb\"" Jun 03 19:46:39.961324 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.961297 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 19:46:39.966592 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.966561 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hsdmq"] Jun 03 19:46:39.972524 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.972494 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh"] Jun 03 19:46:39.976376 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.976351 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:39.979081 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.979061 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-482ps\"" Jun 03 19:46:39.980877 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.979750 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 19:46:39.992559 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:39.992532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh"] Jun 03 19:46:40.064631 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.064575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phgfc\" (UniqueName: \"kubernetes.io/projected/6833057d-1b20-4e88-a594-55b1f3e80f5e-kube-api-access-phgfc\") pod \"llmisvc-controller-manager-864bfd7bc9-zwxbh\" (UID: \"6833057d-1b20-4e88-a594-55b1f3e80f5e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:40.064631 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.064641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c696dda4-7f9f-4108-a08c-e268d9ed3697-cert\") pod \"kserve-controller-manager-69fc866d76-hsdmq\" (UID: \"c696dda4-7f9f-4108-a08c-e268d9ed3697\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:40.064875 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.064740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6833057d-1b20-4e88-a594-55b1f3e80f5e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zwxbh\" (UID: \"6833057d-1b20-4e88-a594-55b1f3e80f5e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:40.064875 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.064773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp2sd\" (UniqueName: \"kubernetes.io/projected/c696dda4-7f9f-4108-a08c-e268d9ed3697-kube-api-access-lp2sd\") pod \"kserve-controller-manager-69fc866d76-hsdmq\" (UID: \"c696dda4-7f9f-4108-a08c-e268d9ed3697\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:40.165872 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.165833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp2sd\" (UniqueName: \"kubernetes.io/projected/c696dda4-7f9f-4108-a08c-e268d9ed3697-kube-api-access-lp2sd\") pod \"kserve-controller-manager-69fc866d76-hsdmq\" (UID: \"c696dda4-7f9f-4108-a08c-e268d9ed3697\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:40.166083 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.165883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phgfc\" (UniqueName: \"kubernetes.io/projected/6833057d-1b20-4e88-a594-55b1f3e80f5e-kube-api-access-phgfc\") pod \"llmisvc-controller-manager-864bfd7bc9-zwxbh\" (UID: \"6833057d-1b20-4e88-a594-55b1f3e80f5e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:40.166083 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.165912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c696dda4-7f9f-4108-a08c-e268d9ed3697-cert\") pod \"kserve-controller-manager-69fc866d76-hsdmq\" (UID: \"c696dda4-7f9f-4108-a08c-e268d9ed3697\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:40.166083 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.165960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6833057d-1b20-4e88-a594-55b1f3e80f5e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zwxbh\" (UID: \"6833057d-1b20-4e88-a594-55b1f3e80f5e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:40.166083 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:46:40.166061 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 03 19:46:40.166252 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:46:40.166119 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6833057d-1b20-4e88-a594-55b1f3e80f5e-cert podName:6833057d-1b20-4e88-a594-55b1f3e80f5e nodeName:}" failed. No retries permitted until 2026-06-03 19:46:40.666099682 +0000 UTC m=+358.976256927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6833057d-1b20-4e88-a594-55b1f3e80f5e-cert") pod "llmisvc-controller-manager-864bfd7bc9-zwxbh" (UID: "6833057d-1b20-4e88-a594-55b1f3e80f5e") : secret "llmisvc-webhook-server-cert" not found Jun 03 19:46:40.168627 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.168600 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c696dda4-7f9f-4108-a08c-e268d9ed3697-cert\") pod \"kserve-controller-manager-69fc866d76-hsdmq\" (UID: \"c696dda4-7f9f-4108-a08c-e268d9ed3697\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:40.191427 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.191393 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phgfc\" (UniqueName: \"kubernetes.io/projected/6833057d-1b20-4e88-a594-55b1f3e80f5e-kube-api-access-phgfc\") pod \"llmisvc-controller-manager-864bfd7bc9-zwxbh\" (UID: \"6833057d-1b20-4e88-a594-55b1f3e80f5e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:40.191572 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.191502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp2sd\" (UniqueName: \"kubernetes.io/projected/c696dda4-7f9f-4108-a08c-e268d9ed3697-kube-api-access-lp2sd\") pod \"kserve-controller-manager-69fc866d76-hsdmq\" (UID: \"c696dda4-7f9f-4108-a08c-e268d9ed3697\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:40.265540 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.265445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:40.404062 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.404028 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hsdmq"] Jun 03 19:46:40.407016 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:40.406989 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc696dda4_7f9f_4108_a08c_e268d9ed3697.slice/crio-fa47c5784820869d9e7a1ae635376ca87241fcc9568dcbd80f59ed8770a2c563 WatchSource:0}: Error finding container fa47c5784820869d9e7a1ae635376ca87241fcc9568dcbd80f59ed8770a2c563: Status 404 returned error can't find the container with id fa47c5784820869d9e7a1ae635376ca87241fcc9568dcbd80f59ed8770a2c563 Jun 03 19:46:40.669464 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.669427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6833057d-1b20-4e88-a594-55b1f3e80f5e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zwxbh\" (UID: \"6833057d-1b20-4e88-a594-55b1f3e80f5e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:40.671885 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.671863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6833057d-1b20-4e88-a594-55b1f3e80f5e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zwxbh\" (UID: \"6833057d-1b20-4e88-a594-55b1f3e80f5e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:40.715437 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.715404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" event={"ID":"c696dda4-7f9f-4108-a08c-e268d9ed3697","Type":"ContainerStarted","Data":"fa47c5784820869d9e7a1ae635376ca87241fcc9568dcbd80f59ed8770a2c563"} Jun 03 19:46:40.890738 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:40.890673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:41.020191 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:41.020160 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh"] Jun 03 19:46:41.023268 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:41.023241 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6833057d_1b20_4e88_a594_55b1f3e80f5e.slice/crio-5090479d64e67464f02c8768b44c37573bde29260e4529abd913fef43a1ba076 WatchSource:0}: Error finding container 5090479d64e67464f02c8768b44c37573bde29260e4529abd913fef43a1ba076: Status 404 returned error can't find the container with id 5090479d64e67464f02c8768b44c37573bde29260e4529abd913fef43a1ba076 Jun 03 19:46:41.722141 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:41.722094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" event={"ID":"6833057d-1b20-4e88-a594-55b1f3e80f5e","Type":"ContainerStarted","Data":"5090479d64e67464f02c8768b44c37573bde29260e4529abd913fef43a1ba076"} Jun 03 19:46:43.734296 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:43.734251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" event={"ID":"c696dda4-7f9f-4108-a08c-e268d9ed3697","Type":"ContainerStarted","Data":"783a91e89ba14d0bbaa5956f6b16e707e74f1e7a3a784f7b02db093c07e4af22"} Jun 03 19:46:43.734797 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:43.734408 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:46:43.763179 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:43.763119 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" podStartSLOduration=2.019010422 podStartE2EDuration="4.7631019s" totalImagesPullingTime="2.744091478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:43.761237218 +0000 UTC m=+362.071394482" watchObservedRunningTime="2026-06-03 19:46:43.7631019 +0000 UTC m=+362.073259150" Jun 03 19:46:44.740213 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:44.740176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" event={"ID":"6833057d-1b20-4e88-a594-55b1f3e80f5e","Type":"ContainerStarted","Data":"09dcb18e18e15990b23c6d54e1c5d76577b091c241c0fe77d6edd311f3c0ed82"} Jun 03 19:46:44.740729 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:44.740403 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:46:44.757515 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:44.757465 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" podStartSLOduration=2.570344122 podStartE2EDuration="5.757445119s" totalImagesPullingTime="3.187100997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:44.756530785 +0000 UTC m=+363.066688036" watchObservedRunningTime="2026-06-03 19:46:44.757445119 +0000 UTC m=+363.067602371" Jun 03 19:46:45.697725 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:45.697696 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-xcbkd" Jun 03 19:46:45.699615 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:45.699592 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-6dchl" Jun 03 19:46:49.228418 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.228378 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk"] Jun 03 19:46:49.232016 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.231996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.234947 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.234923 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 19:46:49.235081 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.235018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-hwhdv\"" Jun 03 19:46:49.235266 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.235252 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 19:46:49.250191 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.250167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk"] Jun 03 19:46:49.348560 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.348520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7be794c5-53ea-4f6f-af5b-0f4d889d6e84-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dn5wk\" (UID: \"7be794c5-53ea-4f6f-af5b-0f4d889d6e84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.348560 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.348562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql4fh\" (UniqueName: \"kubernetes.io/projected/7be794c5-53ea-4f6f-af5b-0f4d889d6e84-kube-api-access-ql4fh\") pod \"servicemesh-operator3-57f65f65fb-dn5wk\" (UID: \"7be794c5-53ea-4f6f-af5b-0f4d889d6e84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.449417 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.449381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7be794c5-53ea-4f6f-af5b-0f4d889d6e84-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dn5wk\" (UID: \"7be794c5-53ea-4f6f-af5b-0f4d889d6e84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.449417 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.449419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql4fh\" (UniqueName: \"kubernetes.io/projected/7be794c5-53ea-4f6f-af5b-0f4d889d6e84-kube-api-access-ql4fh\") pod \"servicemesh-operator3-57f65f65fb-dn5wk\" (UID: \"7be794c5-53ea-4f6f-af5b-0f4d889d6e84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.451903 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.451882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7be794c5-53ea-4f6f-af5b-0f4d889d6e84-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dn5wk\" (UID: \"7be794c5-53ea-4f6f-af5b-0f4d889d6e84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.457757 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.457736 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql4fh\" (UniqueName: \"kubernetes.io/projected/7be794c5-53ea-4f6f-af5b-0f4d889d6e84-kube-api-access-ql4fh\") pod \"servicemesh-operator3-57f65f65fb-dn5wk\" (UID: \"7be794c5-53ea-4f6f-af5b-0f4d889d6e84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.541864 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.541769 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:49.686936 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.686892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk"] Jun 03 19:46:49.689722 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:49.689668 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be794c5_53ea_4f6f_af5b_0f4d889d6e84.slice/crio-527148afb16e7a5a420c5e3d3c66bdcdc0ba5de1556931a8b41dbd7b7e15b577 WatchSource:0}: Error finding container 527148afb16e7a5a420c5e3d3c66bdcdc0ba5de1556931a8b41dbd7b7e15b577: Status 404 returned error can't find the container with id 527148afb16e7a5a420c5e3d3c66bdcdc0ba5de1556931a8b41dbd7b7e15b577 Jun 03 19:46:49.765166 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:49.765132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" event={"ID":"7be794c5-53ea-4f6f-af5b-0f4d889d6e84","Type":"ContainerStarted","Data":"527148afb16e7a5a420c5e3d3c66bdcdc0ba5de1556931a8b41dbd7b7e15b577"} Jun 03 19:46:52.782294 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:52.782206 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" event={"ID":"7be794c5-53ea-4f6f-af5b-0f4d889d6e84","Type":"ContainerStarted","Data":"b4eb9e03deeb55fb788033a622ee23e363bb5b7e2bbed5dab295803121f5989e"} Jun 03 19:46:52.782294 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:52.782279 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:46:52.806417 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:52.806363 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" podStartSLOduration=1.145862638 podStartE2EDuration="3.806343882s" totalImagesPullingTime="2.660481244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:52.805016553 +0000 UTC m=+371.115173804" watchObservedRunningTime="2026-06-03 19:46:52.806343882 +0000 UTC m=+371.116501134" Jun 03 19:46:58.217692 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.217635 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp"] Jun 03 19:46:58.224158 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.224135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.228129 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.228100 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vkcnr\"" Jun 03 19:46:58.228252 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.228140 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 19:46:58.243760 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.243737 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp"] Jun 03 19:46:58.327042 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327253 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.327526 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.327372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g77lt\" (UniqueName: \"kubernetes.io/projected/33b8257d-d516-45b3-9f29-fd17e38eb2ca-kube-api-access-g77lt\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428412 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428577 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428577 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.428747 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.429006 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g77lt\" (UniqueName: \"kubernetes.io/projected/33b8257d-d516-45b3-9f29-fd17e38eb2ca-kube-api-access-g77lt\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.429006 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.428888 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.429110 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.429085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.429257 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.429234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.429331 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.429288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.429586 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.429565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.431058 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.431037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.431200 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.431180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.438850 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.438829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g77lt\" (UniqueName: \"kubernetes.io/projected/33b8257d-d516-45b3-9f29-fd17e38eb2ca-kube-api-access-g77lt\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.441481 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.441461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b8257d-d516-45b3-9f29-fd17e38eb2ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qqftp\" (UID: \"33b8257d-d516-45b3-9f29-fd17e38eb2ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.535004 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.534918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:46:58.692348 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.692319 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp"] Jun 03 19:46:58.694553 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:58.694512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b8257d_d516_45b3_9f29_fd17e38eb2ca.slice/crio-a33b4e695ae02ebd03323ff1dec4e8883e0c90c3ce5f3f466e474246db80b78f WatchSource:0}: Error finding container a33b4e695ae02ebd03323ff1dec4e8883e0c90c3ce5f3f466e474246db80b78f: Status 404 returned error can't find the container with id a33b4e695ae02ebd03323ff1dec4e8883e0c90c3ce5f3f466e474246db80b78f Jun 03 19:46:58.748251 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.748214 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d7b4f9498-6cfv7"] Jun 03 19:46:58.753192 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.753173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:58.757646 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.757626 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 19:46:58.757780 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.757769 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9p9nf\"" Jun 03 19:46:58.763358 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.763332 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d7b4f9498-6cfv7"] Jun 03 19:46:58.814353 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.814271 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" event={"ID":"33b8257d-d516-45b3-9f29-fd17e38eb2ca","Type":"ContainerStarted","Data":"a33b4e695ae02ebd03323ff1dec4e8883e0c90c3ce5f3f466e474246db80b78f"} Jun 03 19:46:58.833751 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.833722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/884bf68f-5bfd-4c0f-afd4-ac4fde131066-redirect-config\") pod \"dashboard-redirect-6d7b4f9498-6cfv7\" (UID: \"884bf68f-5bfd-4c0f-afd4-ac4fde131066\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:58.833877 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.833838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfx4\" (UniqueName: \"kubernetes.io/projected/884bf68f-5bfd-4c0f-afd4-ac4fde131066-kube-api-access-8bfx4\") pod \"dashboard-redirect-6d7b4f9498-6cfv7\" (UID: \"884bf68f-5bfd-4c0f-afd4-ac4fde131066\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:58.935003 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.934969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfx4\" (UniqueName: \"kubernetes.io/projected/884bf68f-5bfd-4c0f-afd4-ac4fde131066-kube-api-access-8bfx4\") pod \"dashboard-redirect-6d7b4f9498-6cfv7\" (UID: \"884bf68f-5bfd-4c0f-afd4-ac4fde131066\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:58.935209 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.935035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/884bf68f-5bfd-4c0f-afd4-ac4fde131066-redirect-config\") pod \"dashboard-redirect-6d7b4f9498-6cfv7\" (UID: \"884bf68f-5bfd-4c0f-afd4-ac4fde131066\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:58.935977 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.935951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/884bf68f-5bfd-4c0f-afd4-ac4fde131066-redirect-config\") pod \"dashboard-redirect-6d7b4f9498-6cfv7\" (UID: \"884bf68f-5bfd-4c0f-afd4-ac4fde131066\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:58.943561 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:58.943538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfx4\" (UniqueName: \"kubernetes.io/projected/884bf68f-5bfd-4c0f-afd4-ac4fde131066-kube-api-access-8bfx4\") pod \"dashboard-redirect-6d7b4f9498-6cfv7\" (UID: \"884bf68f-5bfd-4c0f-afd4-ac4fde131066\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:59.065153 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:59.065071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" Jun 03 19:46:59.201721 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:59.201690 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d7b4f9498-6cfv7"] Jun 03 19:46:59.203626 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:46:59.203599 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884bf68f_5bfd_4c0f_afd4_ac4fde131066.slice/crio-714c24f58b7169ff3e1f7039799a236eba8a6aa3037a2710270ec2ce3b194df4 WatchSource:0}: Error finding container 714c24f58b7169ff3e1f7039799a236eba8a6aa3037a2710270ec2ce3b194df4: Status 404 returned error can't find the container with id 714c24f58b7169ff3e1f7039799a236eba8a6aa3037a2710270ec2ce3b194df4 Jun 03 19:46:59.821166 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:46:59.821127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" event={"ID":"884bf68f-5bfd-4c0f-afd4-ac4fde131066","Type":"ContainerStarted","Data":"714c24f58b7169ff3e1f7039799a236eba8a6aa3037a2710270ec2ce3b194df4"} Jun 03 19:47:03.789109 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:03.789075 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dn5wk" Jun 03 19:47:04.719605 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:04.719564 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:47:04.719730 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:04.719653 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:47:04.719730 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:04.719714 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:47:04.851630 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:04.851590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" event={"ID":"33b8257d-d516-45b3-9f29-fd17e38eb2ca","Type":"ContainerStarted","Data":"0ac5a2c2c0840d164761eff663cafcc5e919f8da9a1625820983109c4cdac314"} Jun 03 19:47:04.853332 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:04.853302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" event={"ID":"884bf68f-5bfd-4c0f-afd4-ac4fde131066","Type":"ContainerStarted","Data":"87e759baad7e14e70a19be94224a6e5bc615f0dd406e8b86f7f490ee53fb90f4"} Jun 03 19:47:04.923781 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:04.923717 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d7b4f9498-6cfv7" podStartSLOduration=1.3975393999999999 podStartE2EDuration="6.923695415s" totalImagesPullingTime="5.526156015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:04.922220031 +0000 UTC m=+383.232377282" watchObservedRunningTime="2026-06-03 19:47:04.923695415 +0000 UTC m=+383.233852656" Jun 03 19:47:04.924378 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:04.924347 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" podStartSLOduration=0.901780527 podStartE2EDuration="6.924335834s" totalImagesPullingTime="6.022555307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:04.886536901 +0000 UTC m=+383.196694152" watchObservedRunningTime="2026-06-03 19:47:04.924335834 +0000 UTC m=+383.234493088" Jun 03 19:47:05.535635 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:05.535600 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:47:05.540403 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:05.540375 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:47:05.857733 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:05.857705 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:47:05.858622 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:05.858602 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qqftp" Jun 03 19:47:14.746059 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:14.746027 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hsdmq" Jun 03 19:47:15.747945 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:15.747913 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zwxbh" Jun 03 19:47:29.964712 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:29.964662 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7mjh"] Jun 03 19:47:29.985503 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:29.985476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" Jun 03 19:47:29.988923 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:29.988890 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:47:29.989266 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:29.989228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:47:29.989896 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:29.989874 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5g22g\"" Jun 03 19:47:29.992782 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:29.992758 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7mjh"] Jun 03 19:47:30.110459 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.110420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rd6z\" (UniqueName: \"kubernetes.io/projected/f19b007a-058e-4bed-a83c-bd5ddbb711c3-kube-api-access-5rd6z\") pod \"kuadrant-operator-catalog-j7mjh\" (UID: \"f19b007a-058e-4bed-a83c-bd5ddbb711c3\") " pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" Jun 03 19:47:30.211380 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.211324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rd6z\" (UniqueName: \"kubernetes.io/projected/f19b007a-058e-4bed-a83c-bd5ddbb711c3-kube-api-access-5rd6z\") pod \"kuadrant-operator-catalog-j7mjh\" (UID: \"f19b007a-058e-4bed-a83c-bd5ddbb711c3\") " pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" Jun 03 19:47:30.220627 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.220555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rd6z\" (UniqueName: \"kubernetes.io/projected/f19b007a-058e-4bed-a83c-bd5ddbb711c3-kube-api-access-5rd6z\") pod \"kuadrant-operator-catalog-j7mjh\" (UID: \"f19b007a-058e-4bed-a83c-bd5ddbb711c3\") " pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" Jun 03 19:47:30.273489 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.273456 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7mjh"] Jun 03 19:47:30.273779 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.273766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" Jun 03 19:47:30.413082 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.413056 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7mjh"] Jun 03 19:47:30.415306 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:47:30.415276 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19b007a_058e_4bed_a83c_bd5ddbb711c3.slice/crio-48a090162f321069c29064b22732f75563d7639184ae09b6b2ec481892a8f716 WatchSource:0}: Error finding container 48a090162f321069c29064b22732f75563d7639184ae09b6b2ec481892a8f716: Status 404 returned error can't find the container with id 48a090162f321069c29064b22732f75563d7639184ae09b6b2ec481892a8f716 Jun 03 19:47:30.482031 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.481942 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m9ggz"] Jun 03 19:47:30.486773 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.486753 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:30.493813 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.493778 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m9ggz"] Jun 03 19:47:30.614810 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.614768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjqvv\" (UniqueName: \"kubernetes.io/projected/03578eaf-1e2a-4858-b8b6-206704fceb0f-kube-api-access-mjqvv\") pod \"kuadrant-operator-catalog-m9ggz\" (UID: \"03578eaf-1e2a-4858-b8b6-206704fceb0f\") " pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:30.716049 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.716011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqvv\" (UniqueName: \"kubernetes.io/projected/03578eaf-1e2a-4858-b8b6-206704fceb0f-kube-api-access-mjqvv\") pod \"kuadrant-operator-catalog-m9ggz\" (UID: \"03578eaf-1e2a-4858-b8b6-206704fceb0f\") " pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:30.726637 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.726602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqvv\" (UniqueName: \"kubernetes.io/projected/03578eaf-1e2a-4858-b8b6-206704fceb0f-kube-api-access-mjqvv\") pod \"kuadrant-operator-catalog-m9ggz\" (UID: \"03578eaf-1e2a-4858-b8b6-206704fceb0f\") " pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:30.798357 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.798259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:30.932261 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.932236 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m9ggz"] Jun 03 19:47:30.934941 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:47:30.934910 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03578eaf_1e2a_4858_b8b6_206704fceb0f.slice/crio-44b259173ae102c7f22a41fb089f3279d21162815d04b9aa61e14787987ff376 WatchSource:0}: Error finding container 44b259173ae102c7f22a41fb089f3279d21162815d04b9aa61e14787987ff376: Status 404 returned error can't find the container with id 44b259173ae102c7f22a41fb089f3279d21162815d04b9aa61e14787987ff376 Jun 03 19:47:30.982293 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.982260 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" event={"ID":"03578eaf-1e2a-4858-b8b6-206704fceb0f","Type":"ContainerStarted","Data":"44b259173ae102c7f22a41fb089f3279d21162815d04b9aa61e14787987ff376"} Jun 03 19:47:30.983376 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:30.983354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" event={"ID":"f19b007a-058e-4bed-a83c-bd5ddbb711c3","Type":"ContainerStarted","Data":"48a090162f321069c29064b22732f75563d7639184ae09b6b2ec481892a8f716"} Jun 03 19:47:32.994737 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:32.994660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" event={"ID":"f19b007a-058e-4bed-a83c-bd5ddbb711c3","Type":"ContainerStarted","Data":"1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a"} Jun 03 19:47:32.995185 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:32.994744 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" podUID="f19b007a-058e-4bed-a83c-bd5ddbb711c3" containerName="registry-server" containerID="cri-o://1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a" gracePeriod=2 Jun 03 19:47:32.996172 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:32.996134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" event={"ID":"03578eaf-1e2a-4858-b8b6-206704fceb0f","Type":"ContainerStarted","Data":"4c6781b2508c2cdf186dafe574c7f762bb954314164b7d396e15604cccb1a91d"} Jun 03 19:47:33.010922 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:33.010877 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" podStartSLOduration=1.995012574 podStartE2EDuration="4.010859485s" totalImagesPullingTime="2.015846911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:33.01003682 +0000 UTC m=+411.320194072" watchObservedRunningTime="2026-06-03 19:47:33.010859485 +0000 UTC m=+411.321016735" Jun 03 19:47:33.026071 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:33.026018 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" podStartSLOduration=1.529212048 podStartE2EDuration="3.026002516s" totalImagesPullingTime="1.496790468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:33.024704533 +0000 UTC m=+411.334861784" watchObservedRunningTime="2026-06-03 19:47:33.026002516 +0000 UTC m=+411.336159771" Jun 03 19:47:33.245724 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:33.245661 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" Jun 03 19:47:33.339024 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:33.338990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rd6z\" (UniqueName: \"kubernetes.io/projected/f19b007a-058e-4bed-a83c-bd5ddbb711c3-kube-api-access-5rd6z\") pod \"f19b007a-058e-4bed-a83c-bd5ddbb711c3\" (UID: \"f19b007a-058e-4bed-a83c-bd5ddbb711c3\") " Jun 03 19:47:33.341142 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:33.341116 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19b007a-058e-4bed-a83c-bd5ddbb711c3-kube-api-access-5rd6z" (OuterVolumeSpecName: "kube-api-access-5rd6z") pod "f19b007a-058e-4bed-a83c-bd5ddbb711c3" (UID: "f19b007a-058e-4bed-a83c-bd5ddbb711c3"). InnerVolumeSpecName "kube-api-access-5rd6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:47:33.440378 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:33.440342 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rd6z\" (UniqueName: \"kubernetes.io/projected/f19b007a-058e-4bed-a83c-bd5ddbb711c3-kube-api-access-5rd6z\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:47:34.002032 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.001995 2562 generic.go:356] "Generic (PLEG): container finished" podID="f19b007a-058e-4bed-a83c-bd5ddbb711c3" containerID="1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a" exitCode=0 Jun 03 19:47:34.002445 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.002044 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" Jun 03 19:47:34.002445 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.002085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" event={"ID":"f19b007a-058e-4bed-a83c-bd5ddbb711c3","Type":"ContainerDied","Data":"1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a"} Jun 03 19:47:34.002445 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.002142 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7mjh" event={"ID":"f19b007a-058e-4bed-a83c-bd5ddbb711c3","Type":"ContainerDied","Data":"48a090162f321069c29064b22732f75563d7639184ae09b6b2ec481892a8f716"} Jun 03 19:47:34.002445 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.002169 2562 scope.go:117] "RemoveContainer" containerID="1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a" Jun 03 19:47:34.012399 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.012381 2562 scope.go:117] "RemoveContainer" containerID="1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a" Jun 03 19:47:34.012648 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:47:34.012630 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a\": container with ID starting with 1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a not found: ID does not exist" containerID="1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a" Jun 03 19:47:34.012730 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.012656 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a"} err="failed to get container status \"1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a\": rpc error: code = NotFound desc = could not find container \"1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a\": container with ID starting with 1286aa6f4713209dea00cba633271d6145b47996b2c9f5d930aa332a9d1cad5a not found: ID does not exist" Jun 03 19:47:34.023613 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.023589 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7mjh"] Jun 03 19:47:34.026557 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.026536 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7mjh"] Jun 03 19:47:34.099136 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:34.099105 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f19b007a-058e-4bed-a83c-bd5ddbb711c3" path="/var/lib/kubelet/pods/f19b007a-058e-4bed-a83c-bd5ddbb711c3/volumes" Jun 03 19:47:40.798802 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:40.798767 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:40.799316 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:40.798828 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:40.821148 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:40.821122 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:47:41.059080 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:47:41.058997 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m9ggz" Jun 03 19:48:01.920171 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:01.920093 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc"] Jun 03 19:48:01.920564 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:01.920545 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19b007a-058e-4bed-a83c-bd5ddbb711c3" containerName="registry-server" Jun 03 19:48:01.920564 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:01.920559 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19b007a-058e-4bed-a83c-bd5ddbb711c3" containerName="registry-server" Jun 03 19:48:01.920637 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:01.920628 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19b007a-058e-4bed-a83c-bd5ddbb711c3" containerName="registry-server" Jun 03 19:48:01.944757 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:01.944726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:01.947385 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:01.947357 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc"] Jun 03 19:48:01.947577 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:01.947556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fxmdx\"" Jun 03 19:48:02.097559 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:02.097526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zwv5\" (UniqueName: \"kubernetes.io/projected/b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5-kube-api-access-8zwv5\") pod \"limitador-operator-controller-manager-859d7b78bd-n5bxc\" (UID: \"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:02.198088 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:02.197989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zwv5\" (UniqueName: \"kubernetes.io/projected/b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5-kube-api-access-8zwv5\") pod \"limitador-operator-controller-manager-859d7b78bd-n5bxc\" (UID: \"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:02.219281 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:02.219249 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zwv5\" (UniqueName: \"kubernetes.io/projected/b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5-kube-api-access-8zwv5\") pod \"limitador-operator-controller-manager-859d7b78bd-n5bxc\" (UID: \"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:02.255884 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:02.255844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:02.421165 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:02.421138 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc"] Jun 03 19:48:02.424011 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:48:02.423977 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45bc894_f1b5_4d5e_8dbc_915a5d5e6df5.slice/crio-832ade4d3806d93bd07cda0689ab7c77b70f0f4a7bda570305acbb3aef19a476 WatchSource:0}: Error finding container 832ade4d3806d93bd07cda0689ab7c77b70f0f4a7bda570305acbb3aef19a476: Status 404 returned error can't find the container with id 832ade4d3806d93bd07cda0689ab7c77b70f0f4a7bda570305acbb3aef19a476 Jun 03 19:48:03.142310 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:03.142269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" event={"ID":"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5","Type":"ContainerStarted","Data":"832ade4d3806d93bd07cda0689ab7c77b70f0f4a7bda570305acbb3aef19a476"} Jun 03 19:48:05.155119 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:05.155079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" event={"ID":"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5","Type":"ContainerStarted","Data":"4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8"} Jun 03 19:48:05.155520 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:05.155227 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:05.172921 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:05.172871 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" podStartSLOduration=2.282143303 podStartE2EDuration="4.172854471s" totalImagesPullingTime="1.890711168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:05.171189177 +0000 UTC m=+443.481346445" watchObservedRunningTime="2026-06-03 19:48:05.172854471 +0000 UTC m=+443.483011722" Jun 03 19:48:05.988840 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:05.988797 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb"] Jun 03 19:48:05.994944 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:05.994911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" Jun 03 19:48:05.997344 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:05.997322 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gd89m\"" Jun 03 19:48:06.001238 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:06.001206 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb"] Jun 03 19:48:06.032094 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:06.032059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtgd\" (UniqueName: \"kubernetes.io/projected/cf9be763-41e9-4eb9-9157-71d55ec0e6db-kube-api-access-nvtgd\") pod \"authorino-operator-75cc8d5cb7-7bvdb\" (UID: \"cf9be763-41e9-4eb9-9157-71d55ec0e6db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" Jun 03 19:48:06.132544 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:06.132515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtgd\" (UniqueName: \"kubernetes.io/projected/cf9be763-41e9-4eb9-9157-71d55ec0e6db-kube-api-access-nvtgd\") pod \"authorino-operator-75cc8d5cb7-7bvdb\" (UID: \"cf9be763-41e9-4eb9-9157-71d55ec0e6db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" Jun 03 19:48:06.143807 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:06.143778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtgd\" (UniqueName: \"kubernetes.io/projected/cf9be763-41e9-4eb9-9157-71d55ec0e6db-kube-api-access-nvtgd\") pod \"authorino-operator-75cc8d5cb7-7bvdb\" (UID: \"cf9be763-41e9-4eb9-9157-71d55ec0e6db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" Jun 03 19:48:06.306431 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:06.306337 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" Jun 03 19:48:06.466422 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:06.466396 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb"] Jun 03 19:48:06.467935 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:48:06.467907 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9be763_41e9_4eb9_9157_71d55ec0e6db.slice/crio-6076b41be492a6422fb827ec9477c939a4984e4d9844693b849183cf6fd35397 WatchSource:0}: Error finding container 6076b41be492a6422fb827ec9477c939a4984e4d9844693b849183cf6fd35397: Status 404 returned error can't find the container with id 6076b41be492a6422fb827ec9477c939a4984e4d9844693b849183cf6fd35397 Jun 03 19:48:07.167276 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:07.167236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" event={"ID":"cf9be763-41e9-4eb9-9157-71d55ec0e6db","Type":"ContainerStarted","Data":"6076b41be492a6422fb827ec9477c939a4984e4d9844693b849183cf6fd35397"} Jun 03 19:48:09.179452 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:09.179411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" event={"ID":"cf9be763-41e9-4eb9-9157-71d55ec0e6db","Type":"ContainerStarted","Data":"7d5ef549a0ae5a9e4cefb469af1407cd70ae15aef88abba23c2ddbdac7f4717c"} Jun 03 19:48:09.179884 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:09.179483 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" Jun 03 19:48:09.200918 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:09.200872 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" podStartSLOduration=2.076828588 podStartE2EDuration="4.200855943s" totalImagesPullingTime="2.124027355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:09.199438475 +0000 UTC m=+447.509595739" watchObservedRunningTime="2026-06-03 19:48:09.200855943 +0000 UTC m=+447.511013194" Jun 03 19:48:16.162182 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:16.162149 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:20.186615 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:20.186584 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7bvdb" Jun 03 19:48:32.976398 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:32.976362 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn"] Jun 03 19:48:32.978742 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:32.978726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:32.982791 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:32.982771 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mhpgf\"" Jun 03 19:48:32.996309 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:32.996287 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn"] Jun 03 19:48:33.073189 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.073153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg6bv\" (UniqueName: \"kubernetes.io/projected/962976a4-acb9-4443-8f60-2306e5a11cfc-kube-api-access-rg6bv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vnjvn\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.073356 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.073250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/962976a4-acb9-4443-8f60-2306e5a11cfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vnjvn\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.103303 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.103275 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn"] Jun 03 19:48:33.103530 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:48:33.103512 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rg6bv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" podUID="962976a4-acb9-4443-8f60-2306e5a11cfc" Jun 03 19:48:33.174245 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.174207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg6bv\" (UniqueName: \"kubernetes.io/projected/962976a4-acb9-4443-8f60-2306e5a11cfc-kube-api-access-rg6bv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vnjvn\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.174425 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.174290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/962976a4-acb9-4443-8f60-2306e5a11cfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vnjvn\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.174712 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.174666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/962976a4-acb9-4443-8f60-2306e5a11cfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vnjvn\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.188740 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.188713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg6bv\" (UniqueName: \"kubernetes.io/projected/962976a4-acb9-4443-8f60-2306e5a11cfc-kube-api-access-rg6bv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vnjvn\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.303170 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.303088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.309136 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.309116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:33.376505 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.376470 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg6bv\" (UniqueName: \"kubernetes.io/projected/962976a4-acb9-4443-8f60-2306e5a11cfc-kube-api-access-rg6bv\") pod \"962976a4-acb9-4443-8f60-2306e5a11cfc\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " Jun 03 19:48:33.376719 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.376591 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/962976a4-acb9-4443-8f60-2306e5a11cfc-extensions-socket-volume\") pod \"962976a4-acb9-4443-8f60-2306e5a11cfc\" (UID: \"962976a4-acb9-4443-8f60-2306e5a11cfc\") " Jun 03 19:48:33.376900 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.376875 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/962976a4-acb9-4443-8f60-2306e5a11cfc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "962976a4-acb9-4443-8f60-2306e5a11cfc" (UID: "962976a4-acb9-4443-8f60-2306e5a11cfc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:48:33.378659 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.378631 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/962976a4-acb9-4443-8f60-2306e5a11cfc-kube-api-access-rg6bv" (OuterVolumeSpecName: "kube-api-access-rg6bv") pod "962976a4-acb9-4443-8f60-2306e5a11cfc" (UID: "962976a4-acb9-4443-8f60-2306e5a11cfc"). InnerVolumeSpecName "kube-api-access-rg6bv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:48:33.477108 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.477077 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/962976a4-acb9-4443-8f60-2306e5a11cfc-extensions-socket-volume\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:48:33.477108 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.477105 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg6bv\" (UniqueName: \"kubernetes.io/projected/962976a4-acb9-4443-8f60-2306e5a11cfc-kube-api-access-rg6bv\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:48:33.545907 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.545871 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn"] Jun 03 19:48:33.551386 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.551360 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn"] Jun 03 19:48:33.594220 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.594191 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc"] Jun 03 19:48:33.594443 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.594400 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" containerName="manager" containerID="cri-o://4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8" gracePeriod=2 Jun 03 19:48:33.600911 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.600880 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv"] Jun 03 19:48:33.603585 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.603562 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.607266 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.607240 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc"] Jun 03 19:48:33.614908 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:48:33.614877 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-n5bxc\": pods \"limitador-operator-controller-manager-859d7b78bd-n5bxc\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:33.618850 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.618828 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv"] Jun 03 19:48:33.626275 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.626254 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm"] Jun 03 19:48:33.626614 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.626603 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" containerName="manager" Jun 03 19:48:33.626658 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.626616 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" containerName="manager" Jun 03 19:48:33.626720 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.626709 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" containerName="manager" Jun 03 19:48:33.628616 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.628600 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" Jun 03 19:48:33.643496 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.643473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm"] Jun 03 19:48:33.644238 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:48:33.644205 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n5bxc\" is forbidden: User \"system:node:ip-10-0-140-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-247.ec2.internal' and this object" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:33.646375 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:48:33.646345 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n5bxc\" is forbidden: User \"system:node:ip-10-0-140-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-247.ec2.internal' and this object" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:33.678363 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.678342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdvv\" (UniqueName: \"kubernetes.io/projected/5d732768-22fd-4521-b827-646304740b4b-kube-api-access-nkdvv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85shv\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.678481 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.678373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d732768-22fd-4521-b827-646304740b4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85shv\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.779198 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.779167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdvv\" (UniqueName: \"kubernetes.io/projected/5d732768-22fd-4521-b827-646304740b4b-kube-api-access-nkdvv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85shv\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.779360 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.779204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d732768-22fd-4521-b827-646304740b4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85shv\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.779360 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.779230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cxp\" (UniqueName: \"kubernetes.io/projected/386bdcb9-bdf3-4517-8592-61bc9cedc74b-kube-api-access-t4cxp\") pod \"limitador-operator-controller-manager-859d7b78bd-qb2xm\" (UID: \"386bdcb9-bdf3-4517-8592-61bc9cedc74b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" Jun 03 19:48:33.779549 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.779529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d732768-22fd-4521-b827-646304740b4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85shv\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.789763 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.789735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdvv\" (UniqueName: \"kubernetes.io/projected/5d732768-22fd-4521-b827-646304740b4b-kube-api-access-nkdvv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85shv\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.826377 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.826355 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:33.828518 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:48:33.828497 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n5bxc\" is forbidden: User \"system:node:ip-10-0-140-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-247.ec2.internal' and this object" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:33.880193 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.880113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cxp\" (UniqueName: \"kubernetes.io/projected/386bdcb9-bdf3-4517-8592-61bc9cedc74b-kube-api-access-t4cxp\") pod \"limitador-operator-controller-manager-859d7b78bd-qb2xm\" (UID: \"386bdcb9-bdf3-4517-8592-61bc9cedc74b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" Jun 03 19:48:33.888807 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.888784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cxp\" (UniqueName: \"kubernetes.io/projected/386bdcb9-bdf3-4517-8592-61bc9cedc74b-kube-api-access-t4cxp\") pod \"limitador-operator-controller-manager-859d7b78bd-qb2xm\" (UID: \"386bdcb9-bdf3-4517-8592-61bc9cedc74b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" Jun 03 19:48:33.971904 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.971875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:33.977575 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.977555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" Jun 03 19:48:33.981390 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.981366 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zwv5\" (UniqueName: \"kubernetes.io/projected/b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5-kube-api-access-8zwv5\") pod \"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5\" (UID: \"b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5\") " Jun 03 19:48:33.983454 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:33.983417 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5-kube-api-access-8zwv5" (OuterVolumeSpecName: "kube-api-access-8zwv5") pod "b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" (UID: "b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5"). InnerVolumeSpecName "kube-api-access-8zwv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:48:34.082421 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.082389 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zwv5\" (UniqueName: \"kubernetes.io/projected/b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5-kube-api-access-8zwv5\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:48:34.103304 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.103269 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="962976a4-acb9-4443-8f60-2306e5a11cfc" path="/var/lib/kubelet/pods/962976a4-acb9-4443-8f60-2306e5a11cfc/volumes" Jun 03 19:48:34.103981 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.103956 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" path="/var/lib/kubelet/pods/b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5/volumes" Jun 03 19:48:34.124921 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.124895 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv"] Jun 03 19:48:34.126837 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:48:34.126812 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d732768_22fd_4521_b827_646304740b4b.slice/crio-97af9ffbec7297d5fb3037419c58cd5b3d215e2e7140496b667ce4113e4fa308 WatchSource:0}: Error finding container 97af9ffbec7297d5fb3037419c58cd5b3d215e2e7140496b667ce4113e4fa308: Status 404 returned error can't find the container with id 97af9ffbec7297d5fb3037419c58cd5b3d215e2e7140496b667ce4113e4fa308 Jun 03 19:48:34.140399 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.140371 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm"] Jun 03 19:48:34.141720 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:48:34.141699 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386bdcb9_bdf3_4517_8592_61bc9cedc74b.slice/crio-78eb76c242d0aec8142b2a9e1d2438eecbc924f283812494d3e792707fd29e18 WatchSource:0}: Error finding container 78eb76c242d0aec8142b2a9e1d2438eecbc924f283812494d3e792707fd29e18: Status 404 returned error can't find the container with id 78eb76c242d0aec8142b2a9e1d2438eecbc924f283812494d3e792707fd29e18 Jun 03 19:48:34.309215 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.309172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" event={"ID":"5d732768-22fd-4521-b827-646304740b4b","Type":"ContainerStarted","Data":"97af9ffbec7297d5fb3037419c58cd5b3d215e2e7140496b667ce4113e4fa308"} Jun 03 19:48:34.310487 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.310461 2562 generic.go:356] "Generic (PLEG): container finished" podID="b45bc894-f1b5-4d5e-8dbc-915a5d5e6df5" containerID="4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8" exitCode=0 Jun 03 19:48:34.310617 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.310514 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n5bxc" Jun 03 19:48:34.310617 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.310566 2562 scope.go:117] "RemoveContainer" containerID="4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8" Jun 03 19:48:34.312356 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.312323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" event={"ID":"386bdcb9-bdf3-4517-8592-61bc9cedc74b","Type":"ContainerStarted","Data":"3211dc8b37e19b1ae42939a8ab32c8b3daa078c38e9a7b7f97de415585f434bd"} Jun 03 19:48:34.312457 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.312371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" event={"ID":"386bdcb9-bdf3-4517-8592-61bc9cedc74b","Type":"ContainerStarted","Data":"78eb76c242d0aec8142b2a9e1d2438eecbc924f283812494d3e792707fd29e18"} Jun 03 19:48:34.312576 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.312560 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" Jun 03 19:48:34.312663 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.312638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vnjvn" Jun 03 19:48:34.319961 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.319943 2562 scope.go:117] "RemoveContainer" containerID="4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8" Jun 03 19:48:34.320221 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:48:34.320203 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8\": container with ID starting with 4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8 not found: ID does not exist" containerID="4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8" Jun 03 19:48:34.320282 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.320235 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8"} err="failed to get container status \"4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8\": rpc error: code = NotFound desc = could not find container \"4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8\": container with ID starting with 4e84fe3b4a38955f34defdf67178e01abf7272c762acab635c72c1ace3f257c8 not found: ID does not exist" Jun 03 19:48:34.344512 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:34.344468 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" podStartSLOduration=1.344456364 podStartE2EDuration="1.344456364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:34.342916648 +0000 UTC m=+472.653073900" watchObservedRunningTime="2026-06-03 19:48:34.344456364 +0000 UTC m=+472.654613616" Jun 03 19:48:38.337520 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:38.337485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" event={"ID":"5d732768-22fd-4521-b827-646304740b4b","Type":"ContainerStarted","Data":"df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed"} Jun 03 19:48:38.337968 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:38.337560 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:38.356844 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:38.356793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" podStartSLOduration=1.69316696 podStartE2EDuration="5.3567774s" totalImagesPullingTime="3.66361044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:38.355611803 +0000 UTC m=+476.665769055" watchObservedRunningTime="2026-06-03 19:48:38.3567774 +0000 UTC m=+476.666934650" Jun 03 19:48:45.321573 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:45.321543 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qb2xm" Jun 03 19:48:49.034468 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.034422 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv"] Jun 03 19:48:49.035069 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.034629 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" podUID="5d732768-22fd-4521-b827-646304740b4b" containerName="manager" containerID="cri-o://df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed" gracePeriod=10 Jun 03 19:48:49.037096 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.037073 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:49.292847 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.292779 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:49.391462 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.391424 2562 generic.go:356] "Generic (PLEG): container finished" podID="5d732768-22fd-4521-b827-646304740b4b" containerID="df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed" exitCode=0 Jun 03 19:48:49.391636 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.391469 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" Jun 03 19:48:49.391636 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.391502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" event={"ID":"5d732768-22fd-4521-b827-646304740b4b","Type":"ContainerDied","Data":"df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed"} Jun 03 19:48:49.391636 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.391550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv" event={"ID":"5d732768-22fd-4521-b827-646304740b4b","Type":"ContainerDied","Data":"97af9ffbec7297d5fb3037419c58cd5b3d215e2e7140496b667ce4113e4fa308"} Jun 03 19:48:49.391636 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.391572 2562 scope.go:117] "RemoveContainer" containerID="df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed" Jun 03 19:48:49.400216 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.400199 2562 scope.go:117] "RemoveContainer" containerID="df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed" Jun 03 19:48:49.400489 ip-10-0-140-247 kubenswrapper[2562]: E0603 19:48:49.400468 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed\": container with ID starting with df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed not found: ID does not exist" containerID="df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed" Jun 03 19:48:49.400615 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.400500 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed"} err="failed to get container status \"df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed\": rpc error: code = NotFound desc = could not find container \"df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed\": container with ID starting with df00ac295abd9f0ba1320d6fa1a1dd2121b068a360ada49d7ccb175bd8039eed not found: ID does not exist" Jun 03 19:48:49.416921 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.416263 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkdvv\" (UniqueName: \"kubernetes.io/projected/5d732768-22fd-4521-b827-646304740b4b-kube-api-access-nkdvv\") pod \"5d732768-22fd-4521-b827-646304740b4b\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " Jun 03 19:48:49.416921 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.416351 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d732768-22fd-4521-b827-646304740b4b-extensions-socket-volume\") pod \"5d732768-22fd-4521-b827-646304740b4b\" (UID: \"5d732768-22fd-4521-b827-646304740b4b\") " Jun 03 19:48:49.417543 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.417246 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d732768-22fd-4521-b827-646304740b4b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5d732768-22fd-4521-b827-646304740b4b" (UID: "5d732768-22fd-4521-b827-646304740b4b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:48:49.420797 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.420013 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d732768-22fd-4521-b827-646304740b4b-kube-api-access-nkdvv" (OuterVolumeSpecName: "kube-api-access-nkdvv") pod "5d732768-22fd-4521-b827-646304740b4b" (UID: "5d732768-22fd-4521-b827-646304740b4b"). InnerVolumeSpecName "kube-api-access-nkdvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:48:49.517417 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.517384 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkdvv\" (UniqueName: \"kubernetes.io/projected/5d732768-22fd-4521-b827-646304740b4b-kube-api-access-nkdvv\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:48:49.517417 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.517413 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d732768-22fd-4521-b827-646304740b4b-extensions-socket-volume\") on node \"ip-10-0-140-247.ec2.internal\" DevicePath \"\"" Jun 03 19:48:49.716931 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.716898 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv"] Jun 03 19:48:49.725816 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:49.725791 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85shv"] Jun 03 19:48:50.098475 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:48:50.098444 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d732768-22fd-4521-b827-646304740b4b" path="/var/lib/kubelet/pods/5d732768-22fd-4521-b827-646304740b4b/volumes" Jun 03 19:49:05.304008 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.303973 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn"] Jun 03 19:49:05.304386 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.304357 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d732768-22fd-4521-b827-646304740b4b" containerName="manager" Jun 03 19:49:05.304386 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.304368 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d732768-22fd-4521-b827-646304740b4b" containerName="manager" Jun 03 19:49:05.304498 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.304474 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d732768-22fd-4521-b827-646304740b4b" containerName="manager" Jun 03 19:49:05.307610 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.307580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.310008 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.309984 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vq4w4\"" Jun 03 19:49:05.320897 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.320876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn"] Jun 03 19:49:05.435089 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435271 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435271 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435359 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435359 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435444 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435424 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-987ct\" (UniqueName: \"kubernetes.io/projected/5f0d5a85-34a7-427c-9bbf-831a49243e4b-kube-api-access-987ct\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435516 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435461 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.435516 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.435487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.535942 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.535912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.535942 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.535945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536176 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.535968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536176 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.535999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536176 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-987ct\" (UniqueName: \"kubernetes.io/projected/5f0d5a85-34a7-427c-9bbf-831a49243e4b-kube-api-access-987ct\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536176 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536176 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536176 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536473 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536473 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536390 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536646 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536627 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536748 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.536805 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.536743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.537043 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.537025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.538439 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.538413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.538565 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.538549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.553703 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.553664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f0d5a85-34a7-427c-9bbf-831a49243e4b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.553811 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.553743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-987ct\" (UniqueName: \"kubernetes.io/projected/5f0d5a85-34a7-427c-9bbf-831a49243e4b-kube-api-access-987ct\") pod \"maas-default-gateway-openshift-default-687ff6996-mwlzn\" (UID: \"5f0d5a85-34a7-427c-9bbf-831a49243e4b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.621870 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.621829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:05.768490 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.768465 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn"] Jun 03 19:49:05.770530 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:49:05.770507 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0d5a85_34a7_427c_9bbf_831a49243e4b.slice/crio-cdb207beb0cb6ba93cccb11a18668bc3d866264598e4b2a9f798722366b681c9 WatchSource:0}: Error finding container cdb207beb0cb6ba93cccb11a18668bc3d866264598e4b2a9f798722366b681c9: Status 404 returned error can't find the container with id cdb207beb0cb6ba93cccb11a18668bc3d866264598e4b2a9f798722366b681c9 Jun 03 19:49:05.772518 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.772488 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:49:05.772590 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.772548 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:49:05.772590 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:05.772579 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:49:06.472992 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:06.472957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" event={"ID":"5f0d5a85-34a7-427c-9bbf-831a49243e4b","Type":"ContainerStarted","Data":"3a6d7d553820a47f88aa83767dedf7ca6b0da618e5b56c9e51fa372f9056536b"} Jun 03 19:49:06.473363 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:06.473012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" event={"ID":"5f0d5a85-34a7-427c-9bbf-831a49243e4b","Type":"ContainerStarted","Data":"cdb207beb0cb6ba93cccb11a18668bc3d866264598e4b2a9f798722366b681c9"} Jun 03 19:49:06.497286 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:06.497234 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" podStartSLOduration=1.49721694 podStartE2EDuration="1.49721694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:49:06.494626559 +0000 UTC m=+504.804783812" watchObservedRunningTime="2026-06-03 19:49:06.49721694 +0000 UTC m=+504.807374191" Jun 03 19:49:06.622985 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:06.622953 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:06.627586 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:06.627564 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:07.478353 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:07.478304 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:07.479254 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:07.479231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:49:20.481284 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.481248 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:49:20.485743 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.485720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.488351 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.488327 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 19:49:20.488446 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.488354 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xckcv\"" Jun 03 19:49:20.494532 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.494512 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:49:20.529348 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.529314 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:49:20.569331 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.569292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b852e57-b074-4e03-a1c3-14a3db7a0364-config-file\") pod \"limitador-limitador-54d6d988d5-xqgdv\" (UID: \"7b852e57-b074-4e03-a1c3-14a3db7a0364\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.569487 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.569376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdxl7\" (UniqueName: \"kubernetes.io/projected/7b852e57-b074-4e03-a1c3-14a3db7a0364-kube-api-access-zdxl7\") pod \"limitador-limitador-54d6d988d5-xqgdv\" (UID: \"7b852e57-b074-4e03-a1c3-14a3db7a0364\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.670564 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.670527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdxl7\" (UniqueName: \"kubernetes.io/projected/7b852e57-b074-4e03-a1c3-14a3db7a0364-kube-api-access-zdxl7\") pod \"limitador-limitador-54d6d988d5-xqgdv\" (UID: \"7b852e57-b074-4e03-a1c3-14a3db7a0364\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.670760 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.670605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b852e57-b074-4e03-a1c3-14a3db7a0364-config-file\") pod \"limitador-limitador-54d6d988d5-xqgdv\" (UID: \"7b852e57-b074-4e03-a1c3-14a3db7a0364\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.671352 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.671332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b852e57-b074-4e03-a1c3-14a3db7a0364-config-file\") pod \"limitador-limitador-54d6d988d5-xqgdv\" (UID: \"7b852e57-b074-4e03-a1c3-14a3db7a0364\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.679574 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.679543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdxl7\" (UniqueName: \"kubernetes.io/projected/7b852e57-b074-4e03-a1c3-14a3db7a0364-kube-api-access-zdxl7\") pod \"limitador-limitador-54d6d988d5-xqgdv\" (UID: \"7b852e57-b074-4e03-a1c3-14a3db7a0364\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.797646 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.797559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:20.939211 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:20.939186 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:49:20.941944 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:49:20.941903 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b852e57_b074_4e03_a1c3_14a3db7a0364.slice/crio-be36c1e8bcbb9984b893fadfb9b6eb267a130eb7b48906896bff6b49c9e0e199 WatchSource:0}: Error finding container be36c1e8bcbb9984b893fadfb9b6eb267a130eb7b48906896bff6b49c9e0e199: Status 404 returned error can't find the container with id be36c1e8bcbb9984b893fadfb9b6eb267a130eb7b48906896bff6b49c9e0e199 Jun 03 19:49:21.550064 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:21.550023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" event={"ID":"7b852e57-b074-4e03-a1c3-14a3db7a0364","Type":"ContainerStarted","Data":"be36c1e8bcbb9984b893fadfb9b6eb267a130eb7b48906896bff6b49c9e0e199"} Jun 03 19:49:23.563344 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:23.563256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" event={"ID":"7b852e57-b074-4e03-a1c3-14a3db7a0364","Type":"ContainerStarted","Data":"7f6b45c365129a9adaf20deb135d732197a8ed40ce8e245b52f00db90bdd584f"} Jun 03 19:49:23.563344 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:23.563319 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:49:23.581754 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:23.581703 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" podStartSLOduration=1.250032179 podStartE2EDuration="3.581664748s" totalImagesPullingTime="2.331632569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:49:23.580191631 +0000 UTC m=+521.890348883" watchObservedRunningTime="2026-06-03 19:49:23.581664748 +0000 UTC m=+521.891821999" Jun 03 19:49:34.570118 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:49:34.570045 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xqgdv" Jun 03 19:50:42.073416 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:50:42.073376 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:50:42.074400 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:50:42.074378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:51:28.380283 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:28.380248 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:51:36.232222 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:36.232187 2562 generic.go:356] "Generic (PLEG): container finished" podID="5f0d5a85-34a7-427c-9bbf-831a49243e4b" containerID="3a6d7d553820a47f88aa83767dedf7ca6b0da618e5b56c9e51fa372f9056536b" exitCode=0 Jun 03 19:51:36.232639 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:36.232249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" event={"ID":"5f0d5a85-34a7-427c-9bbf-831a49243e4b","Type":"ContainerDied","Data":"3a6d7d553820a47f88aa83767dedf7ca6b0da618e5b56c9e51fa372f9056536b"} Jun 03 19:51:36.232639 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:36.232598 2562 scope.go:117] "RemoveContainer" containerID="3a6d7d553820a47f88aa83767dedf7ca6b0da618e5b56c9e51fa372f9056536b" Jun 03 19:51:36.233703 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:36.233653 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:51:36.233779 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:36.233760 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:51:36.233829 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:36.233812 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 19:51:37.240085 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:37.240048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" event={"ID":"5f0d5a85-34a7-427c-9bbf-831a49243e4b","Type":"ContainerStarted","Data":"f5ca9662c17656eb49136dc8de9ae4d73b8aa64fc99f41b7eb5b0264dddacd86"} Jun 03 19:51:37.479000 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:37.478964 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:51:37.622195 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:37.622155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:51:37.623272 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:37.623243 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mwlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 03 19:51:37.623383 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:37.623299 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" podUID="5f0d5a85-34a7-427c-9bbf-831a49243e4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 03 19:51:38.622475 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:38.622441 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mwlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 03 19:51:38.622866 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:38.622509 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" podUID="5f0d5a85-34a7-427c-9bbf-831a49243e4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 03 19:51:39.622398 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:39.622363 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mwlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 03 19:51:39.622572 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:39.622420 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" podUID="5f0d5a85-34a7-427c-9bbf-831a49243e4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 03 19:51:40.622507 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:40.622465 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mwlzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 03 19:51:40.622794 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:40.622519 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" podUID="5f0d5a85-34a7-427c-9bbf-831a49243e4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 03 19:51:41.626293 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:41.626260 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:51:41.627141 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:51:41.627122 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mwlzn" Jun 03 19:52:32.284305 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.284199 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds"] Jun 03 19:52:32.288276 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.288254 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.291101 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.291074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 19:52:32.291903 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.291884 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dj52g\"" Jun 03 19:52:32.291977 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.291942 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 19:52:32.292148 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.292127 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 19:52:32.303686 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.303644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds"] Jun 03 19:52:32.464776 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.464738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwr67\" (UniqueName: \"kubernetes.io/projected/c57aeef4-7a4b-4002-813a-bcb1cde36e66-kube-api-access-hwr67\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.464968 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.464799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.464968 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.464829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.464968 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.464847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.464968 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.464868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.464968 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.464943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57aeef4-7a4b-4002-813a-bcb1cde36e66-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566212 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566212 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566212 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566212 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57aeef4-7a4b-4002-813a-bcb1cde36e66-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566537 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwr67\" (UniqueName: \"kubernetes.io/projected/c57aeef4-7a4b-4002-813a-bcb1cde36e66-kube-api-access-hwr67\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566537 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566653 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566653 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.566774 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.566659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.568498 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.568475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c57aeef4-7a4b-4002-813a-bcb1cde36e66-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.568799 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.568782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57aeef4-7a4b-4002-813a-bcb1cde36e66-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.575144 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.575122 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwr67\" (UniqueName: \"kubernetes.io/projected/c57aeef4-7a4b-4002-813a-bcb1cde36e66-kube-api-access-hwr67\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds\" (UID: \"c57aeef4-7a4b-4002-813a-bcb1cde36e66\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.599086 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.599061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:52:32.739347 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.739320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds"] Jun 03 19:52:32.740649 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:52:32.740624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57aeef4_7a4b_4002_813a_bcb1cde36e66.slice/crio-1660b0856cf301c1d34ef87b31c4995d9c745af2e56f4040bd9a51de7f0635ec WatchSource:0}: Error finding container 1660b0856cf301c1d34ef87b31c4995d9c745af2e56f4040bd9a51de7f0635ec: Status 404 returned error can't find the container with id 1660b0856cf301c1d34ef87b31c4995d9c745af2e56f4040bd9a51de7f0635ec Jun 03 19:52:32.742499 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.742482 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:52:32.902237 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:32.902201 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:52:33.514441 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:33.514406 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" event={"ID":"c57aeef4-7a4b-4002-813a-bcb1cde36e66","Type":"ContainerStarted","Data":"1660b0856cf301c1d34ef87b31c4995d9c745af2e56f4040bd9a51de7f0635ec"} Jun 03 19:52:36.531460 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:36.531372 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" event={"ID":"c57aeef4-7a4b-4002-813a-bcb1cde36e66","Type":"ContainerStarted","Data":"69fb6581a32c3f8ed31987649e2c6e82f8fab10b79eb8d688937b9e2660c437e"} Jun 03 19:52:48.992965 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:52:48.992929 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:53:04.439190 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.439154 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx"] Jun 03 19:53:04.443080 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.443058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.445882 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.445861 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 19:53:04.453293 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.453269 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx"] Jun 03 19:53:04.555460 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.555413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.555646 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.555503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.555646 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.555541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9wcd\" (UniqueName: \"kubernetes.io/projected/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-kube-api-access-l9wcd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.555646 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.555573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.555646 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.555595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.555828 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.555707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657003 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.656953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657003 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657279 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9wcd\" (UniqueName: \"kubernetes.io/projected/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-kube-api-access-l9wcd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657279 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657279 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657279 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657530 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657653 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.657653 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.657573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.659311 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.659293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.659612 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.659592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.665936 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.665914 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9wcd\" (UniqueName: \"kubernetes.io/projected/a5990e8d-10a5-49c4-94ad-88cd9da3b76e-kube-api-access-l9wcd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx\" (UID: \"a5990e8d-10a5-49c4-94ad-88cd9da3b76e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.754854 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.754776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:04.887342 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:04.887316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx"] Jun 03 19:53:04.889937 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:53:04.889909 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5990e8d_10a5_49c4_94ad_88cd9da3b76e.slice/crio-7f50198306c643c2992641bc81e2f51b34ae912a731da6369c249ff75d9a2988 WatchSource:0}: Error finding container 7f50198306c643c2992641bc81e2f51b34ae912a731da6369c249ff75d9a2988: Status 404 returned error can't find the container with id 7f50198306c643c2992641bc81e2f51b34ae912a731da6369c249ff75d9a2988 Jun 03 19:53:05.595791 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:05.595757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:53:05.675756 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:05.675720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" event={"ID":"a5990e8d-10a5-49c4-94ad-88cd9da3b76e","Type":"ContainerStarted","Data":"25d086440510cebbb06868dfce9cd8e5bbb4dce4907e7361914ad7ccc8048ba2"} Jun 03 19:53:05.675944 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:05.675789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" event={"ID":"a5990e8d-10a5-49c4-94ad-88cd9da3b76e","Type":"ContainerStarted","Data":"7f50198306c643c2992641bc81e2f51b34ae912a731da6369c249ff75d9a2988"} Jun 03 19:53:06.682118 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:06.682088 2562 generic.go:356] "Generic (PLEG): container finished" podID="a5990e8d-10a5-49c4-94ad-88cd9da3b76e" containerID="25d086440510cebbb06868dfce9cd8e5bbb4dce4907e7361914ad7ccc8048ba2" exitCode=0 Jun 03 19:53:06.682522 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:06.682170 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" event={"ID":"a5990e8d-10a5-49c4-94ad-88cd9da3b76e","Type":"ContainerDied","Data":"25d086440510cebbb06868dfce9cd8e5bbb4dce4907e7361914ad7ccc8048ba2"} Jun 03 19:53:08.695205 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:08.695172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" event={"ID":"a5990e8d-10a5-49c4-94ad-88cd9da3b76e","Type":"ContainerStarted","Data":"a8522df33be213f8d62a50c2995bfb6e6c3c76d76f3453ddcb7d09760d423987"} Jun 03 19:53:08.717418 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:08.717374 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" podStartSLOduration=2.335837733 podStartE2EDuration="4.717359131s" totalImagesPullingTime="1.110838988s" totalInitContainerRuntime="1.27068241s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:53:08.715042841 +0000 UTC m=+747.025200090" watchObservedRunningTime="2026-06-03 19:53:08.717359131 +0000 UTC m=+747.027516380" Jun 03 19:53:12.354668 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.354637 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6"] Jun 03 19:53:12.359367 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.359345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.362080 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.362059 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 19:53:12.370408 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.370387 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6"] Jun 03 19:53:12.432964 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.432933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-782hp\" (UniqueName: \"kubernetes.io/projected/4559e09e-5d8d-4ac3-80db-5412f61af5e8-kube-api-access-782hp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.433141 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.432971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.433141 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.432996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.433141 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.433092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.433267 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.433157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4559e09e-5d8d-4ac3-80db-5412f61af5e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.433267 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.433201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534378 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4559e09e-5d8d-4ac3-80db-5412f61af5e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534378 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534591 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-782hp\" (UniqueName: \"kubernetes.io/projected/4559e09e-5d8d-4ac3-80db-5412f61af5e8-kube-api-access-782hp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534591 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534591 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534591 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534899 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.534964 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.535009 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.534980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.536844 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.536825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4559e09e-5d8d-4ac3-80db-5412f61af5e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.536979 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.536964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4559e09e-5d8d-4ac3-80db-5412f61af5e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.555552 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.555525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-782hp\" (UniqueName: \"kubernetes.io/projected/4559e09e-5d8d-4ac3-80db-5412f61af5e8-kube-api-access-782hp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6\" (UID: \"4559e09e-5d8d-4ac3-80db-5412f61af5e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.669982 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.669886 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:53:12.806019 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:12.805996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6"] Jun 03 19:53:12.807628 ip-10-0-140-247 kubenswrapper[2562]: W0603 19:53:12.807602 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4559e09e_5d8d_4ac3_80db_5412f61af5e8.slice/crio-bb1b17052124cd513623bbaacda4b508f42772e0c6a0203b4ac511f4a5988069 WatchSource:0}: Error finding container bb1b17052124cd513623bbaacda4b508f42772e0c6a0203b4ac511f4a5988069: Status 404 returned error can't find the container with id bb1b17052124cd513623bbaacda4b508f42772e0c6a0203b4ac511f4a5988069 Jun 03 19:53:13.492659 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:13.492626 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:53:13.720924 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:13.720888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" event={"ID":"4559e09e-5d8d-4ac3-80db-5412f61af5e8","Type":"ContainerStarted","Data":"2549c36f498a04ab108abe2837013e3cd54595f776b4104e794c80b9f1ba5585"} Jun 03 19:53:13.721122 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:13.720940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" event={"ID":"4559e09e-5d8d-4ac3-80db-5412f61af5e8","Type":"ContainerStarted","Data":"bb1b17052124cd513623bbaacda4b508f42772e0c6a0203b4ac511f4a5988069"} Jun 03 19:53:14.755481 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:14.755443 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:14.755901 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:14.755545 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:14.768037 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:14.768008 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:15.741219 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:15.741192 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx" Jun 03 19:53:28.803636 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:28.803601 2562 generic.go:356] "Generic (PLEG): container finished" podID="c57aeef4-7a4b-4002-813a-bcb1cde36e66" containerID="69fb6581a32c3f8ed31987649e2c6e82f8fab10b79eb8d688937b9e2660c437e" exitCode=0 Jun 03 19:53:28.804056 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:28.803665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" event={"ID":"c57aeef4-7a4b-4002-813a-bcb1cde36e66","Type":"ContainerDied","Data":"69fb6581a32c3f8ed31987649e2c6e82f8fab10b79eb8d688937b9e2660c437e"} Jun 03 19:53:29.811231 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:29.811196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" event={"ID":"c57aeef4-7a4b-4002-813a-bcb1cde36e66","Type":"ContainerStarted","Data":"810e1961272e0ba6623d8735f608a5d12ee67af0337654015c5928e7ff98ce4f"} Jun 03 19:53:29.833742 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:29.833667 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" podStartSLOduration=2.377440256 podStartE2EDuration="57.833650843s" totalImagesPullingTime="3.775597023s" totalInitContainerRuntime="51.680613564s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:52:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:53:29.83280514 +0000 UTC m=+768.142962393" watchObservedRunningTime="2026-06-03 19:53:29.833650843 +0000 UTC m=+768.143808094" Jun 03 19:53:32.497394 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:32.497358 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:53:32.599922 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:32.599880 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:53:32.600112 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:32.599948 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:53:32.613112 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:32.613078 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:53:32.838229 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:32.838203 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds" Jun 03 19:53:57.001946 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:53:57.001904 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:54:07.007333 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:07.007296 2562 generic.go:356] "Generic (PLEG): container finished" podID="4559e09e-5d8d-4ac3-80db-5412f61af5e8" containerID="2549c36f498a04ab108abe2837013e3cd54595f776b4104e794c80b9f1ba5585" exitCode=0 Jun 03 19:54:07.007849 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:07.007372 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" event={"ID":"4559e09e-5d8d-4ac3-80db-5412f61af5e8","Type":"ContainerDied","Data":"2549c36f498a04ab108abe2837013e3cd54595f776b4104e794c80b9f1ba5585"} Jun 03 19:54:08.014880 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:08.014845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" event={"ID":"4559e09e-5d8d-4ac3-80db-5412f61af5e8","Type":"ContainerStarted","Data":"b86e640ec7463cc802b8a589144c2a04dd60d86faaa75d4fd6cd40b700fea62b"} Jun 03 19:54:08.036420 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:08.036369 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" podStartSLOduration=2.395903267 podStartE2EDuration="56.036352598s" totalImagesPullingTime="240.272092ms" totalInitContainerRuntime="53.400177239s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:54:08.035552799 +0000 UTC m=+806.345710050" watchObservedRunningTime="2026-06-03 19:54:08.036352598 +0000 UTC m=+806.346509848" Jun 03 19:54:12.670128 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:12.670086 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:54:12.670516 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:12.670162 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:54:12.682727 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:12.682702 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:54:13.051776 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:54:13.051691 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6" Jun 03 19:55:28.204150 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:55:28.204109 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:55:39.500223 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:55:39.500188 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:55:42.104738 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:55:42.104710 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:55:42.107726 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:55:42.107705 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 19:55:48.797884 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:55:48.797851 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:55:58.503735 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:55:58.503695 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:56:07.698647 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:56:07.698601 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:56:17.306983 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:56:17.306946 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:56:48.799567 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:56:48.799532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:56:55.105663 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:56:55.105619 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:57:33.095654 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:57:33.095580 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:57:47.292771 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:57:47.292736 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:58:26.215465 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:58:26.215430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:58:43.598886 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:58:43.598849 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:58:58.304455 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:58:58.304413 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 19:59:13.497660 ip-10-0-140-247 kubenswrapper[2562]: I0603 19:59:13.497624 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:00:08.603984 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:00:08.603882 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:00:17.702976 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:00:17.702937 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:00:33.098203 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:00:33.098166 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:00:42.135474 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:00:42.135447 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:00:42.139384 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:00:42.139360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:00:42.497337 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:00:42.497253 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:00:59.301766 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:00:59.301731 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:01:08.597255 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:01:08.597213 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:01:40.103005 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:01:40.102926 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:01:48.403143 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:01:48.403103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:01:56.896625 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:01:56.896579 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:02:04.799749 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:02:04.799706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:02:14.491406 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:02:14.491365 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:02:31.201096 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:02:31.201060 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:02:43.399114 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:02:43.399069 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:03:31.351732 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:03:31.351617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:03:37.304083 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:03:37.304048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:03:44.298871 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:03:44.298829 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:03:54.401072 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:03:54.401036 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:04:03.397934 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:04:03.397894 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:04:10.798439 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:04:10.798394 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:04:19.694386 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:04:19.694349 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:04:28.102255 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:04:28.102221 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:04:38.898990 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:04:38.898905 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:04:46.311591 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:04:46.311556 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:04:54.591798 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:04:54.591761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:05:03.804596 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:03.804561 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:05:11.908341 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:11.908302 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:05:20.800772 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:20.800731 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:05:29.700741 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:29.700701 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:05:37.904046 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:37.904013 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:05:42.168539 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:42.168508 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:05:42.175148 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:42.175123 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:05:46.697805 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:46.697768 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:05:55.487568 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:05:55.487528 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:08:14.500007 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:08:14.499968 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:08:21.025769 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:08:21.025729 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:08:46.499992 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:08:46.499952 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:08:52.599024 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:08:52.598979 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:09:03.093941 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:09:03.093861 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:09:13.895344 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:09:13.895309 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:09:22.109264 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:09:22.109231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:09:32.897530 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:09:32.897493 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:09:41.894931 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:09:41.894891 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:09:51.489667 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:09:51.489628 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:09:59.893524 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:09:59.893481 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:10:10.598594 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:10:10.598556 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:10:19.692119 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:10:19.692080 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:10:42.203288 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:10:42.203259 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:10:42.208646 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:10:42.208617 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:10:54.801416 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:10:54.801376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:11:38.599175 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:11:38.599138 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:11:47.499250 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:11:47.499210 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:11:56.306301 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:11:56.306257 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:12:03.504099 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:12:03.504012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:12:11.898268 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:12:11.898221 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:12:26.295559 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:12:26.295515 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:12:34.996313 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:12:34.996276 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:12:43.188537 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:12:43.188491 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:12:51.795447 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:12:51.795405 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:13:00.196691 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:13:00.196643 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:13:10.592036 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:13:10.591997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:13:22.100773 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:13:22.100738 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:13:40.191673 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:13:40.191598 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:13:49.003293 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:13:49.003254 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:13:57.999445 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:13:57.999407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:14:04.197479 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:14:04.197444 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:14:22.706879 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:14:22.706843 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:14:31.697329 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:14:31.697288 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:14:38.300773 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:14:38.300733 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:14:46.902913 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:14:46.902867 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:14:57.793890 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:14:57.793851 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:15:04.597298 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:04.597199 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:15:14.894205 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:14.894160 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:15:28.304657 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:28.304619 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:15:37.491352 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:37.491310 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:15:42.233794 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:42.233763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:15:42.245367 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:42.245337 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:15:50.696611 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:50.696564 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:15:59.795999 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:15:59.795960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:16:10.797868 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:16:10.797801 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:16:17.394447 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:16:17.394409 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:16:27.400234 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:16:27.400194 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:16:45.888888 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:16:45.888849 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:16:54.103735 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:16:54.103701 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:17:03.097029 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:17:03.096992 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:17:13.892251 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:17:13.892214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:17:35.494437 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:17:35.494400 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:17:49.005896 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:17:49.005859 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:17:54.594333 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:17:54.594292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xqgdv"] Jun 03 20:18:01.328344 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:01.328317 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d7b4f9498-6cfv7_884bf68f-5bfd-4c0f-afd4-ac4fde131066/nginx/0.log" Jun 03 20:18:01.596321 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:01.596297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hsdmq_c696dda4-7f9f-4108-a08c-e268d9ed3697/manager/0.log" Jun 03 20:18:01.730546 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:01.730515 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zwxbh_6833057d-1b20-4e88-a594-55b1f3e80f5e/manager/0.log" Jun 03 20:18:02.431868 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:02.431838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6dchl_12ef131c-061a-4103-b05a-f3cae690ad81/server/0.log" Jun 03 20:18:02.566869 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:02.566842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-xcbkd_7fef3c6f-14ba-43ce-92fd-df4806cc6193/manager/0.log" Jun 03 20:18:02.692946 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:02.692867 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-cxfjf_ef1e7268-b764-4c40-b240-d3f7280e1f32/copy-manifests/0.log" Jun 03 20:18:02.699153 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:02.699124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-cxfjf_ef1e7268-b764-4c40-b240-d3f7280e1f32/manager/0.log" Jun 03 20:18:04.533956 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:04.533927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7bvdb_cf9be763-41e9-4eb9-9157-71d55ec0e6db/manager/0.log" Jun 03 20:18:04.891545 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:04.891502 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m9ggz_03578eaf-1e2a-4858-b8b6-206704fceb0f/registry-server/0.log" Jun 03 20:18:05.166960 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:05.166870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xqgdv_7b852e57-b074-4e03-a1c3-14a3db7a0364/limitador/0.log" Jun 03 20:18:05.302607 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:05.302578 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qb2xm_386bdcb9-bdf3-4517-8592-61bc9cedc74b/manager/0.log" Jun 03 20:18:05.645914 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:05.645884 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qqftp_33b8257d-d516-45b3-9f29-fd17e38eb2ca/istio-proxy/0.log" Jun 03 20:18:05.884773 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:05.884742 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-8px64_a5a44de9-f948-41e2-9750-cd45258217a7/kube-auth-proxy/0.log" Jun 03 20:18:06.112871 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:06.112840 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/1.log" Jun 03 20:18:06.337071 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:06.337040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfc6575cf-lqd8h_ed04c8db-bd0b-4bb0-858f-34e087e2d38d/router/0.log" Jun 03 20:18:06.691648 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:06.691617 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds_c57aeef4-7a4b-4002-813a-bcb1cde36e66/storage-initializer/0.log" Jun 03 20:18:06.698420 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:06.698400 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nmcds_c57aeef4-7a4b-4002-813a-bcb1cde36e66/main/0.log" Jun 03 20:18:06.923039 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:06.923011 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx_a5990e8d-10a5-49c4-94ad-88cd9da3b76e/storage-initializer/0.log" Jun 03 20:18:06.931169 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:06.931147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gdvmx_a5990e8d-10a5-49c4-94ad-88cd9da3b76e/main/0.log" Jun 03 20:18:07.043008 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:07.042929 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6_4559e09e-5d8d-4ac3-80db-5412f61af5e8/storage-initializer/0.log" Jun 03 20:18:07.049488 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:07.049467 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwdkt6_4559e09e-5d8d-4ac3-80db-5412f61af5e8/main/0.log" Jun 03 20:18:14.450090 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:14.450050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j5wkc_ceb4dea7-8538-462d-92c9-3087b9d43c0c/global-pull-secret-syncer/0.log" Jun 03 20:18:14.569119 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:14.569085 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqrkf_9660a7c0-7142-4512-95cf-9bdeffec62a9/konnectivity-agent/0.log" Jun 03 20:18:14.623692 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:14.623651 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-247.ec2.internal_ab9a8b1c9bd14a20f0e9b74b8d5a4c0a/haproxy/0.log" Jun 03 20:18:17.996046 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:17.996020 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-dn5wk_7be794c5-53ea-4f6f-af5b-0f4d889d6e84/sail-operator/0.log" Jun 03 20:18:20.124577 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:20.124545 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7bvdb_cf9be763-41e9-4eb9-9157-71d55ec0e6db/manager/0.log" Jun 03 20:18:20.213033 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:20.212999 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m9ggz_03578eaf-1e2a-4858-b8b6-206704fceb0f/registry-server/0.log" Jun 03 20:18:20.375338 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:20.375259 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xqgdv_7b852e57-b074-4e03-a1c3-14a3db7a0364/limitador/0.log" Jun 03 20:18:20.462767 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:20.462740 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qb2xm_386bdcb9-bdf3-4517-8592-61bc9cedc74b/manager/0.log" Jun 03 20:18:22.255959 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:22.255913 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-8p6k4_76a35794-56f3-42ab-af30-446edb2934be/cluster-monitoring-operator/0.log" Jun 03 20:18:22.472965 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:22.472933 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-696s4_2e9a65c2-63af-4e4e-b810-0d14d33a9249/node-exporter/0.log" Jun 03 20:18:22.493607 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:22.493580 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-696s4_2e9a65c2-63af-4e4e-b810-0d14d33a9249/kube-rbac-proxy/0.log" Jun 03 20:18:22.514619 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:22.514547 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-696s4_2e9a65c2-63af-4e4e-b810-0d14d33a9249/init-textfile/0.log" Jun 03 20:18:24.648369 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:24.648335 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-xglz6_31999664-3290-426f-be81-720cc7036299/networking-console-plugin/0.log" Jun 03 20:18:25.344328 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:25.344300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/1.log" Jun 03 20:18:25.349073 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:25.349054 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-p7qjt_557bfea7-56e5-499e-b18c-440c11f55d9f/console-operator/2.log" Jun 03 20:18:26.406554 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.406517 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj"] Jun 03 20:18:26.410228 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.410207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.412735 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.412715 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpf8j\"/\"kube-root-ca.crt\"" Jun 03 20:18:26.412856 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.412754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpf8j\"/\"openshift-service-ca.crt\"" Jun 03 20:18:26.413515 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.413496 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpf8j\"/\"default-dockercfg-xw5kt\"" Jun 03 20:18:26.419726 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.419697 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj"] Jun 03 20:18:26.587477 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.587440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbfmz\" (UniqueName: \"kubernetes.io/projected/75a5e512-a404-47ad-a3f0-75b992b2f220-kube-api-access-dbfmz\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.587477 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.587482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-podres\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.587713 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.587555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-sys\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.587713 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.587615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-lib-modules\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.587713 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.587639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-proc\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688665 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-sys\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688665 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-lib-modules\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688665 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-proc\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688905 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-sys\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688905 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbfmz\" (UniqueName: \"kubernetes.io/projected/75a5e512-a404-47ad-a3f0-75b992b2f220-kube-api-access-dbfmz\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688905 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688785 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-lib-modules\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688905 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-proc\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.688905 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-podres\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.689119 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.688937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75a5e512-a404-47ad-a3f0-75b992b2f220-podres\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.696803 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.696782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbfmz\" (UniqueName: \"kubernetes.io/projected/75a5e512-a404-47ad-a3f0-75b992b2f220-kube-api-access-dbfmz\") pod \"perf-node-gather-daemonset-p5tqj\" (UID: \"75a5e512-a404-47ad-a3f0-75b992b2f220\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.714544 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.714514 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-c5xfk_a69dfa68-e1af-466a-ad6c-610762bdcfc0/volume-data-source-validator/0.log" Jun 03 20:18:26.720970 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.720947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:26.855235 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:26.855203 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj"] Jun 03 20:18:26.857115 ip-10-0-140-247 kubenswrapper[2562]: W0603 20:18:26.857090 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod75a5e512_a404_47ad_a3f0_75b992b2f220.slice/crio-aa569cde3ecd03a61d7d22bab3cabb6b3771ef11ba22cd6e2f67d0fcb550b410 WatchSource:0}: Error finding container aa569cde3ecd03a61d7d22bab3cabb6b3771ef11ba22cd6e2f67d0fcb550b410: Status 404 returned error can't find the container with id aa569cde3ecd03a61d7d22bab3cabb6b3771ef11ba22cd6e2f67d0fcb550b410 Jun 03 20:18:27.587568 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:27.587532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" event={"ID":"75a5e512-a404-47ad-a3f0-75b992b2f220","Type":"ContainerStarted","Data":"a9140926e5fc88d46a1bbe91d858f1f0e5b7b3b70281441fda6779c38c8b2b96"} Jun 03 20:18:27.588070 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:27.587619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" event={"ID":"75a5e512-a404-47ad-a3f0-75b992b2f220","Type":"ContainerStarted","Data":"aa569cde3ecd03a61d7d22bab3cabb6b3771ef11ba22cd6e2f67d0fcb550b410"} Jun 03 20:18:27.588070 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:27.587665 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:27.605409 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:27.605361 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" podStartSLOduration=1.6053456769999999 podStartE2EDuration="1.605345677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:18:27.603088643 +0000 UTC m=+2265.913245893" watchObservedRunningTime="2026-06-03 20:18:27.605345677 +0000 UTC m=+2265.915502906" Jun 03 20:18:27.992775 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:27.992663 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxpgd_a183de41-885c-4a77-9971-470bf0631bbd/dns/0.log" Jun 03 20:18:28.011516 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:28.011489 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxpgd_a183de41-885c-4a77-9971-470bf0631bbd/kube-rbac-proxy/0.log" Jun 03 20:18:28.083225 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:28.083195 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zxqck_33e570aa-ee54-4f06-acc7-27580e36aea6/dns-node-resolver/0.log" Jun 03 20:18:28.708694 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:28.708656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-665bw_77a7d526-661c-4266-8e77-d74d1961fb46/node-ca/0.log" Jun 03 20:18:29.695252 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:29.695220 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qqftp_33b8257d-d516-45b3-9f29-fd17e38eb2ca/istio-proxy/0.log" Jun 03 20:18:29.859117 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:29.859087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-8px64_a5a44de9-f948-41e2-9750-cd45258217a7/kube-auth-proxy/0.log" Jun 03 20:18:29.913938 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:29.913906 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/0.log" Jun 03 20:18:29.944406 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:29.944374 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/1.log" Jun 03 20:18:30.033388 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:30.033306 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfc6575cf-lqd8h_ed04c8db-bd0b-4bb0-858f-34e087e2d38d/router/0.log" Jun 03 20:18:30.618528 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:30.618493 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4p8zp_de7bd1e1-eb10-48e8-9f29-db2235f4f27f/serve-healthcheck-canary/0.log" Jun 03 20:18:31.204633 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:31.204596 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-mm7qk_0f463e3a-575a-4f0e-a204-d3a807cdc361/insights-operator/0.log" Jun 03 20:18:31.205368 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:31.205351 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-mm7qk_0f463e3a-575a-4f0e-a204-d3a807cdc361/insights-operator/1.log" Jun 03 20:18:31.301575 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:31.301544 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnd6t_a238fe31-e7a5-4e4a-97a3-6b10c2002780/kube-rbac-proxy/0.log" Jun 03 20:18:31.322211 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:31.322188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnd6t_a238fe31-e7a5-4e4a-97a3-6b10c2002780/exporter/0.log" Jun 03 20:18:31.344079 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:31.344043 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnd6t_a238fe31-e7a5-4e4a-97a3-6b10c2002780/extractor/0.log" Jun 03 20:18:33.602866 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:33.602835 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-p5tqj" Jun 03 20:18:33.623067 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:33.623041 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d7b4f9498-6cfv7_884bf68f-5bfd-4c0f-afd4-ac4fde131066/nginx/0.log" Jun 03 20:18:33.736900 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:33.736868 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hsdmq_c696dda4-7f9f-4108-a08c-e268d9ed3697/manager/0.log" Jun 03 20:18:33.845210 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:33.845174 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zwxbh_6833057d-1b20-4e88-a594-55b1f3e80f5e/manager/0.log" Jun 03 20:18:34.025210 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:34.025122 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6dchl_12ef131c-061a-4103-b05a-f3cae690ad81/server/0.log" Jun 03 20:18:34.071964 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:34.071926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-xcbkd_7fef3c6f-14ba-43ce-92fd-df4806cc6193/manager/0.log" Jun 03 20:18:34.099883 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:34.099853 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-cxfjf_ef1e7268-b764-4c40-b240-d3f7280e1f32/manager/0.log" Jun 03 20:18:34.121441 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:34.121417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-cxfjf_ef1e7268-b764-4c40-b240-d3f7280e1f32/copy-manifests/0.log" Jun 03 20:18:40.074695 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:40.074651 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qqftp_33b8257d-d516-45b3-9f29-fd17e38eb2ca/istio-proxy/0.log" Jun 03 20:18:40.211765 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:40.211731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-8px64_a5a44de9-f948-41e2-9750-cd45258217a7/kube-auth-proxy/0.log" Jun 03 20:18:40.244945 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:40.244916 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/0.log" Jun 03 20:18:40.275903 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:40.275875 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/1.log" Jun 03 20:18:40.358385 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:40.358361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfc6575cf-lqd8h_ed04c8db-bd0b-4bb0-858f-34e087e2d38d/router/0.log" Jun 03 20:18:41.487316 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:41.487285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qqftp_33b8257d-d516-45b3-9f29-fd17e38eb2ca/istio-proxy/0.log" Jun 03 20:18:41.532822 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:41.532783 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-st2dg_a229502e-43c5-4e83-a85a-641526fc518d/migrator/0.log" Jun 03 20:18:41.558886 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:41.558857 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-st2dg_a229502e-43c5-4e83-a85a-641526fc518d/graceful-termination/0.log" Jun 03 20:18:41.640312 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:41.640284 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-8px64_a5a44de9-f948-41e2-9750-cd45258217a7/kube-auth-proxy/0.log" Jun 03 20:18:41.678869 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:41.678844 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/0.log" Jun 03 20:18:41.711755 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:41.711725 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/1.log" Jun 03 20:18:41.782794 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:41.782709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfc6575cf-lqd8h_ed04c8db-bd0b-4bb0-858f-34e087e2d38d/router/0.log" Jun 03 20:18:42.001628 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:42.001597 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9_fc70db4a-592a-4944-9898-17be786a2c21/kube-storage-version-migrator-operator/1.log" Jun 03 20:18:42.002394 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:42.002372 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-vb5h9_fc70db4a-592a-4944-9898-17be786a2c21/kube-storage-version-migrator-operator/0.log" Jun 03 20:18:43.234862 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.234832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7xpcv_fab75079-dc7d-49d5-9e23-548d638c16f9/kube-multus/0.log" Jun 03 20:18:43.257252 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.257229 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5q4fw_38eee980-1217-4628-a494-f1fbf53394cf/kube-multus-additional-cni-plugins/0.log" Jun 03 20:18:43.277735 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.277709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5q4fw_38eee980-1217-4628-a494-f1fbf53394cf/egress-router-binary-copy/0.log" Jun 03 20:18:43.297452 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.297430 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5q4fw_38eee980-1217-4628-a494-f1fbf53394cf/cni-plugins/0.log" Jun 03 20:18:43.318095 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.318071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5q4fw_38eee980-1217-4628-a494-f1fbf53394cf/bond-cni-plugin/0.log" Jun 03 20:18:43.339609 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.339579 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5q4fw_38eee980-1217-4628-a494-f1fbf53394cf/routeoverride-cni/0.log" Jun 03 20:18:43.363620 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.363594 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5q4fw_38eee980-1217-4628-a494-f1fbf53394cf/whereabouts-cni-bincopy/0.log" Jun 03 20:18:43.385174 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.385146 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5q4fw_38eee980-1217-4628-a494-f1fbf53394cf/whereabouts-cni/0.log" Jun 03 20:18:43.422889 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.422856 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qqftp_33b8257d-d516-45b3-9f29-fd17e38eb2ca/istio-proxy/0.log" Jun 03 20:18:43.572801 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.572707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-8px64_a5a44de9-f948-41e2-9750-cd45258217a7/kube-auth-proxy/0.log" Jun 03 20:18:43.604298 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.604270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/0.log" Jun 03 20:18:43.640013 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.639978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mwlzn_5f0d5a85-34a7-427c-9bbf-831a49243e4b/istio-proxy/1.log" Jun 03 20:18:43.706705 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.706661 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfc6575cf-lqd8h_ed04c8db-bd0b-4bb0-858f-34e087e2d38d/router/0.log" Jun 03 20:18:43.822637 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.822600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82bwq_36186242-9a2e-4793-90ec-518e85baecb3/network-metrics-daemon/0.log" Jun 03 20:18:43.840655 ip-10-0-140-247 kubenswrapper[2562]: I0603 20:18:43.840625 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82bwq_36186242-9a2e-4793-90ec-518e85baecb3/kube-rbac-proxy/0.log"